00000001:02000400:0.0F:1783562233.394851:0:2946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783562242.174652:0:3149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1783562243.147853:0:3212:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1291 MB/s 00000001:01000000:2.0:1783562243.397688:0:3212:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1623 MB/s 00000001:01000000:2.0:1783562243.647528:0:3212:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10235 MB/s 00000020:02000000:2.0:1783562243.987006:0:3241:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_105_g7dbd668 00000400:02000000:2.0:1783562244.390887:0:3256:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.104@tcp [8/256/0/180] 00008000:02000000:0.0:1783562246.831099:0:3405:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783562271.407225:0:5210:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1783562275.737364:0:5735:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783562275.737371:0:5735:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783562275.737532:0:5735:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000039b156b0 00000080:02000400:3.0:1783562275.737542:0:5735:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1783562275.741080:0:5735:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1783562275.741094:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783562275.741131:0:5735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e7173b68) 00000020:00000080:3.0:1783562275.741151:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783562275.758378:0:5735:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783562275.758767:0:5735:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783562275.775024:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783562275.775064:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783562275.775086:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783562275.775137:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783562275.775166:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783562275.775607:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783562275.775614:0:5735:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783562275.775624:0:5735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87adc 00000020:01000004:3.0:1783562275.775631:0:5735:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783562275.775635:0:5735:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783562275.775639:0:5735:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000039b156b0 from MGS 00000020:01000004:3.0:1783562275.775644:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783562275.775653:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009b3647af) 00000020:00000080:3.0:1783562275.775663:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783562275.775726:0:5735:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039b156b0 from MGS, refs=2 00080000:01000000:3.0:1783562275.775732:0:5735:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783562275.775736:0:5735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87aea 00000100:00100000:3.0:1783562275.775825:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783562275.775959:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783562275.775966:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783562275.776595:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783562275.776602:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783562275.777275:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562275.777448:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783562275.777453:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783562275.778149:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783562275.778156:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783562275.778493:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783562275.778499:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783562275.779114:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562275.779117:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562275.779119:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562275.779567:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562275.779569:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562275.779571:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562275.780065:0:5735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783562275.789054:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783562276.029629:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5523 MB/s 00000001:01000000:1.0F:1783562276.279481:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5307 MB/s 00000001:01000000:2.0:1783562276.529782:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1215 MB/s 00000001:01000000:2.0:1783562276.779593:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1543 MB/s 00080000:10000000:2.0:1783562276.783890:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1783562276.792244:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783562276.792260:0:5735:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783562276.792263:0:5735:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1783562276.792597:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783562276.793005:0:5746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783562276.793053:0:5735:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783562276.793086:0:5735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1783562276.793212:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783562276.793234:0:5735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783562276.794271:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562276.794481:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783562276.794487:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783562276.795088:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783562276.795093:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783562276.795733:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783562276.795740:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783562276.796308:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783562276.796327:0:5735:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.104@tcp' 00000020:01000004:0.0:1783562276.796328:0:5735:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783562276.796426:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.104@tcp (typ=mgc) 00000020:00000080:0.0:1783562276.796445:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.104@tcp (000000008a02b00e) 00000020:00000080:0.0:1783562276.796461:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783562276.796584:0:5735:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000085e72e9e@MGC192.168.204.104@tcp: add connection 192.168.204.104@tcp at head 00010000:00010000:0.0:1783562276.796718:0:5735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.104@tcp-0 is initialized 00000040:01000000:0.0:1783562276.796724:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783562276.796955:0:5752:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783562276.796977:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.104@tcp (uuid a8ed28a5-c620-431b-88b9-f6805bcdc0a6) 00000020:00000080:0.0:1783562276.796989:0:5735:0:(genops.c:1406:class_connect()) connect: client a8ed28a5-c620-431b-88b9-f6805bcdc0a6, cookie 0x4738ba0933b87af8 00000100:00080000:0.0:1783562276.796998:0:5735:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783562276.797003:0:5735:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import 0000000085e72e9e using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562276.797038:0:5735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d20436f7 x1870200563564672/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783562276.797057:0:5735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS 00000020:01000004:0.0:1783562276.797073:0:5735:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783562276.797082:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783562276.797089:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000043837666) 00000020:00000080:0.0:1783562276.797097:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783562276.800078:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d20436f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563564672:0@lo:250: 00000100:00100000:3.0:1783562276.800209:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562276.800302:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563564672 00000100:00100000:3.0:1783562276.800312:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563564672 00000100:00100000:3.0:1783562276.800349:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562276.800356:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002628cf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3271:x1870200563564672:12345-0@lo:250: 00010000:00080000:3.0:1783562276.800387:0:5748:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a8ed28a5-c620-431b-88b9-f6805bcdc0a6@0@lo t0 exp 0000000000000000 cur 86 last 0 00000020:00000080:3.0:1783562276.800431:0:5748:0:(genops.c:1406:class_connect()) connect: client a8ed28a5-c620-431b-88b9-f6805bcdc0a6, cookie 0x4738ba0933b87b06 00000100:00080000:3.0:1783562276.800568:0:5748:0:(import.c:65:import_set_state_nolock()) 000000008fe288f0 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562276.800615:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002628cf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:3271:x1870200563564672:12345-0@lo:250: Request processed in 258us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562276.800624:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562276.800671:0:3271:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783562276.800679:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1783562276.800686:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783562276.800690:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783562276.800693:0:3271:0:(import.c:65:import_set_state_nolock()) 0000000085e72e9e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783562276.800696:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783562276.800700:0:3271:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783562276.800704:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d20436f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563564672:0@lo:250: 00000100:00080000:3.0:1783562276.800757:0:5751:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1783562276.808549:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.808732:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783562276.808738:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783562276.809187:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562276.809193:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783562276.809459:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562276.809465:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783562276.809979:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.810104:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783562276.810109:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783562276.810521:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783562276.810527:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783562276.833680:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.833860:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783562276.833875:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783562276.834875:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783562276.834883:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783562276.835726:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.835869:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783562276.835883:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783562276.836375:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783562276.836381:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783562276.836954:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.837083:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783562276.837087:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783562276.837902:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783562276.837909:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783562276.839054:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.839233:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783562276.839239:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783562276.840016:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783562276.840028:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783562276.854214:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562276.854454:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783562276.854462:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783562276.855522:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562276.855531:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783562276.856911:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783562276.856930:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783562276.858006:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783562276.858029:0:5735:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783562276.858035:0:5735:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783562276.858245:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783562276.858273:0:5735:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1783562276.858276:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783562276.858278:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783562276.858279:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562276.858279:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562276.858280:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562276.858281:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562276.858282:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783562276.858283:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783562276.858284:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562276.858284:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562276.858285:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562276.858286:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783562276.858288:0:5735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1783562276.858289:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783562276.858290:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783562276.858291:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562276.858291:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562276.858292:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562276.858292:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562276.858293:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783562276.858293:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783562276.858294:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562276.858294:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562276.858295:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562276.858295:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783562276.858326:0:5735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783562276.858340:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007568da96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563564800:0@lo:253: 00000100:00100000:0.0:1783562276.858441:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562276.858487:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000259f9be9 going to sleep for 11 seconds 00000100:00100000:3.0:1783562276.858552:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563564800 00000100:00100000:3.0:1783562276.858561:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563564800 00000100:00100000:3.0:1783562276.858609:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562276.858616:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dc6cccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5735:x1870200563564800:12345-0@lo:253: 20000000:01000000:3.0:1783562276.858679:0:5750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783562276.858682:0:5750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783562276.859082:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783562276.859131:0:5750:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783562276.859569:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562276.860512:0:5771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1783562276.860668:0:5750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783562276.860671:0:5750:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1783562276.860676:0:5750:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1783562276.860680:0:5750:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1783562276.860695:0:5750:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1783562276.860864:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562276.861150:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1783562276.861163:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783562276.861210:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1783562276.861257:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1783562276.861296:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1783562276.861436:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1783562276.861446:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1783562276.861494:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1783562276.861503:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1783562276.861566:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1783562276.861576:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1783562276.861610:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1783562276.861663:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1783562276.861696:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783562276.861700:0:5750:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1783562276.861712:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562276.861952:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1783562276.861963:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783562276.861998:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1783562276.862028:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1783562276.862067:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1783562276.862077:0:5750:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1783562276.862131:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1783562276.862137:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783562276.862163:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1783562276.862186:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1783562276.862203:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1783562276.862210:0:5750:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1783562276.862263:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1783562276.862272:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1783562276.862304:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1783562276.862333:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1783562276.862505:0:5750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1783562276.862551:0:5750:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783562276.862558:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1783562276.862933:0:5772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1783562276.863142:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1783562276.863162:0:5750:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.104@tcp for mdt 20000000:01000000:3.0:1783562276.863163:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.104@tcp (null) (null) (null) 00000040:00080000:3.0:1783562276.863198:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1783562276.863206:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783562276.864318:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1783562276.864333:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.104@tcp (null) (null) 00000040:00080000:3.0:1783562276.864390:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1783562276.864425:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1783562276.864503:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1783562276.864551:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1783562276.864635:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783562276.864639:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783562276.864642:0:5750:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783562276.864653:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783562276.864664:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783562276.864695:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783562276.864698:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783562276.865137:0:5773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1783562276.865352:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783562276.865392:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1783562276.865559:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1783562276.865573:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783562276.865574:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783562276.865962:0:5774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783562276.866170:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783562276.866210:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783562276.866245:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1783562276.866258:0:5750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783562276.866260:0:5750:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1783562276.866264:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783562276.866266:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783562276.866270:0:5750:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783562276.866276:0:5750:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783562276.866656:0:5775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783562276.866759:0:5750:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783562276.872840:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783562276.872876:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783562276.872939:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783562276.872956:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783562276.872973:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.872987:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.872993:0:5750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873007:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873011:0:5750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873015:0:5750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873018:0:5750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001662a13e already unused, calling callback (0000000084a47c21) 00010000:00010000:1.0:1783562276.873020:0:5750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873025:0:5750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873033:0:5750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873038:0:5750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.873041:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001662a13e/0x4738ba0933b87b0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562276.873054:0:5750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783562276.975890:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dc6cccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5735:x1870200563564800:12345-0@lo:253: Request processed in 117267us (117442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562276.975921:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562276.975941:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007568da96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563564800:0@lo:253: 10000000:01000000:2.0:1783562276.975958:0:5735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783562276.975961:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783562276.975963:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562276.975964:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562276.975966:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783562276.975967:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562276.975969:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562276.975970:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562276.975972:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562276.975973:0:5735:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783562276.975975:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562276.975976:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783562276.975995:0:5735:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000039b156b0 from lustre-MDT0000 10000000:01000000:2.0:1783562276.976022:0:5735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783562276.976025:0:5735:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783562276.976030:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bfcc3f199c0 10000000:01000000:2.0:1783562276.976035:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783562276.976043:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfcc3f199c0 from 1 10000000:01000000:2.0:1783562276.976046:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783562276.976102:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.976112:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.976122:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562276.976148:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563564928:0@lo:101: 00000100:00100000:2.0:1783562276.976195:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562276.976260:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783562276.976272:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563564928 00000100:00100000:1.0:1783562276.976280:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563564928 00000100:00100000:1.0:1783562276.976385:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562276.976394:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000620f7b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5735:x1870200563564928:12345-0@lo:101: 00010000:00010000:1.0:1783562276.976437:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562276.976450:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87b14 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.976473:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 6 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.976483:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 6 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562276.976493:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001662a13e, rc 0) 00000100:00100000:1.0:1783562276.976533:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000620f7b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5735:x1870200563564928:12345-0@lo:101: Request processed in 141us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562276.976539:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562276.976571:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563564928:0@lo:101: 00010000:00010000:2.0:1783562276.976580:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.976586:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562276.976615:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565056:0@lo:501: 00000100:00100000:2.0:1783562276.976634:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562276.976688:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565056 00000100:00100000:1.0:1783562276.976693:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565056 00000100:00100000:2.0:1783562276.976694:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783562276.976717:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562276.976723:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8118d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5735:x1870200563565056:12345-0@lo:501: 00000100:00100000:1.0:1783562276.976962:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8118d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5735:x1870200563565056:12345-0@lo:501: Request processed in 239us (326us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562276.976969:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783562276.977007:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565056:0@lo:501: 10000000:01000000:2.0:1783562276.977031:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783562276.977045:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977054:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562276.977062:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcc78df800 10000000:01000000:2.0:1783562276.977066:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783562276.977070:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bfcc78df800 10000000:01000000:2.0:1783562276.977073:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783562276.977075:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9bfcc78df800 from 1 10000000:01000000:2.0:1783562276.977082:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783562276.977104:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977115:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977121:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562276.977134:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565184:0@lo:101: 00000100:00100000:2.0:1783562276.977153:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562276.977170:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:3.0:1783562276.977495:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565184 00000100:00100000:3.0:1783562276.977499:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565184 00000100:00100000:3.0:1783562276.977522:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562276.977526:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d79c1fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5735:x1870200563565184:12345-0@lo:101: 00010000:00010000:3.0:1783562276.977532:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562276.977540:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000747b0c4b/0x4738ba0933b87b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87b22 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562276.977550:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000747b0c4b/0x4738ba0933b87b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87b22 expref: 7 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562276.977560:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000747b0c4b/0x4738ba0933b87b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b22 expref: 7 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562276.977564:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000747b0c4b, rc 0) 00000100:00100000:3.0:1783562276.977603:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d79c1fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:5735:x1870200563565184:12345-0@lo:101: Request processed in 75us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562276.977610:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562276.977661:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565184:0@lo:101: 00010000:00010000:2.0:1783562276.977670:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977675:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562276.977683:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783562276.977690:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977694:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 00000000bef5fa6f/0x4738ba0933b87b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562276.977698:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783562276.977701:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783562276.977705:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bfcc78df800 10000000:01000000:2.0:1783562276.977713:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783562276.977717:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783562276.977719:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783562276.977734:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977740:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.977748:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562276.977759:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565312:0@lo:101: 00000100:00100000:2.0:1783562276.977875:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562276.977902:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:0.0:1783562276.977974:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565312 00000100:00100000:0.0:1783562276.977979:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565312 00000100:00100000:0.0:1783562276.978178:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562276.978186:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d717ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:5735:x1870200563565312:12345-0@lo:101: 00010000:00010000:0.0:1783562276.978205:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562276.978213:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87b30 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562276.978232:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562276.978240:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562276.978247:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d75cfa5, rc 0) 00000100:00100000:0.0:1783562276.978291:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d717ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:5735:x1870200563565312:12345-0@lo:101: Request processed in 107us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562276.978298:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562276.978337:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565312:0@lo:101: 00010000:00010000:2.0:1783562276.978349:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562276.978358:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562276.978398:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565440:0@lo:501: 00000100:00100000:2.0:1783562276.978463:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562276.978492:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:3.0:1783562276.978514:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565440 00000100:00100000:3.0:1783562276.978520:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565440 00000100:00100000:3.0:1783562276.978548:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562276.978554:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcaa0e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:5735:x1870200563565440:12345-0@lo:501: 00000100:00100000:3.0:1783562276.978734:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcaa0e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5735:x1870200563565440:12345-0@lo:501: Request processed in 181us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562276.978742:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562276.978776:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565440:0@lo:501: 00000100:00100000:2.0:1783562276.978804:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565568:0@lo:503: 00000100:00100000:2.0:1783562276.978842:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562276.978880:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054a291e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783562276.978980:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565568 00000100:00100000:1.0:1783562276.978986:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565568 00000100:00100000:1.0:1783562276.979012:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562276.979018:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a68100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5735:x1870200563565568:12345-0@lo:503: 00000100:00100000:1.0:1783562276.979176:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a68100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5735:x1870200563565568:12345-0@lo:503: Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562276.979183:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562276.979334:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565568:0@lo:503: 00000100:00100000:1.0:1783562276.979780:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b1bcee3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5777:1870200563565696:0@lo:502: 00000100:00100000:1.0:1783562276.979822:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562276.979846:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ec9b5ed going to sleep for 11 seconds 00000100:00100000:3.0:1783562276.979864:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565696 00000100:00100000:3.0:1783562276.979869:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565696 00000100:00100000:3.0:1783562276.979958:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562276.979965:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c230211f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5777:x1870200563565696:12345-0@lo:502: 00000100:00100000:3.0:1783562276.980107:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c230211f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5777:x1870200563565696:12345-0@lo:502: Request processed in 143us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562276.980114:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562276.980141:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b1bcee3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5777:1870200563565696:0@lo:502: 00000020:01000000:1.0:1783562276.980161:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562276.980171:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562276.980173:0:5777:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783562276.980177:0:5777:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783562276.980179:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562276.980196:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006255d984) 00000020:00000080:1.0:1783562276.980215:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783562276.980221:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783562276.980333:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783562276.980340:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87b45 00000020:00000080:1.0:1783562276.980563:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783562276.980568:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562276.980571:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562276.980573:0:5777:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783562276.980575:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562276.980578:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562276.980579:0:5777:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783562276.980582:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562276.980588:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d9d349a4) 00000020:00000080:1.0:1783562276.980597:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783562276.980601:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783562276.980603:0:5777:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783562276.980606:0:5777:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783562276.980611:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783562276.980655:0:5777:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039b156b0 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783562276.980667:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000275b4de) 00000020:00000080:1.0:1783562276.980674:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783562276.980728:0:5777:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783562276.980733:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b87b5a 00000020:00000080:1.0:1783562276.980811:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783562276.980816:0:5777:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783562276.980820:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4738ba0933b87b61 00080000:01000000:1.0:1783562276.980825:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783562276.980828:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87b68 00080000:10000000:1.0:1783562276.981196:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1783562276.981394:0:5777:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1783562276.984606:0:5777:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1783562277.025501:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1783562277.025830:0:5777:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1783562277.029159:0:5777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1783562277.029536:0:5777:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783562277.050223:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000faafd565) 00000020:00000080:0.0:1783562277.050266:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783562277.050338:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783562277.050345:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87b76 00000020:00000080:0.0:1783562277.050725:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783562277.052574:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.081730:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.104313:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.130269:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562277.160888:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562277.190952:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1783562277.207568:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4738ba0933b87b7d 00000020:00000080:2.0:1783562277.208020:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783562277.208037:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562277.208046:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562277.208049:0:5777:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783562277.208053:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562277.208057:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562277.208059:0:5777:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783562277.208062:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783562277.208064:0:5777:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783562277.208067:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562277.208070:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562277.208071:0:5777:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783562277.208073:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562277.208080:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562277.208081:0:5777:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783562277.208085:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783562277.208172:0:5777:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1783562277.208253:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5777:1870200563565824:0@lo:502: 00000100:00100000:2.0:1783562277.208367:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562277.208439:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565824 00000100:00100000:1.0:1783562277.208451:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565824 00000100:00100000:2.0:1783562277.208471:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.208510:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783562277.208521:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bb8900f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5777:x1870200563565824:12345-0@lo:502: 00000100:00100000:1.0:1783562277.208955:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bb8900f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5777:x1870200563565824:12345-0@lo:502: Request processed in 435us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.208966:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562277.209009:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5777:1870200563565824:0@lo:502: 00000020:01000000:2.0:1783562277.209044:0:5777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562277.209050:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562277.209051:0:5777:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1783562277.209054:0:5777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1783562277.209155:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1783562277.209182:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783562277.209208:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.209222:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562277.209234:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcc78df800 from 1 10000000:01000000:0.0:1783562277.209238:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783562277.209277:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.209285:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.209295:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562277.209311:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c7e79f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565952:0@lo:101: 00000100:00100000:0.0:1783562277.209358:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562277.209380:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000042988bca going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.209437:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563565952 00000100:00100000:3.0:1783562277.209443:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563565952 00000100:00100000:3.0:1783562277.209475:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562277.209484:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eb1384e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:5735:x1870200563565952:12345-0@lo:101: 00010000:00010000:3.0:1783562277.209496:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562277.209519:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87b84 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.209544:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.209555:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.209564:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000772cad98, rc 0) 00000100:00100000:3.0:1783562277.209605:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eb1384e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:5735:x1870200563565952:12345-0@lo:101: Request processed in 122us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562277.209612:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562277.209627:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c7e79f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563565952:0@lo:101: 00010000:00010000:2.0:1783562277.209643:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.209659:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.210193:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566080:0@lo:256: 00000100:00100000:2.0:1783562277.210235:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.210276:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.210300:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566080 00000100:00100000:1.0:1783562277.210306:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566080 00000100:00100000:1.0:1783562277.210342:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562277.210348:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b7a18a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:5735:x1870200563566080:12345-0@lo:256: 20000000:01000000:1.0:1783562277.210366:0:5749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783562277.210373:0:5749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783562277.210554:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b7a18a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:5735:x1870200563566080:12345-0@lo:256: Request processed in 205us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.210563:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783562277.210572:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566080:0@lo:256: 10000000:01000000:2.0:1783562277.211113:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783562277.211126:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.211134:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562277.211139:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc78df800 from 1 10000000:01000000:2.0:1783562277.211142:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562277.211162:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.211165:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.211170:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.211178:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566208:0@lo:101: 00000100:00100000:2.0:1783562277.211199:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.211231:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.211257:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566208 00000100:00100000:3.0:1783562277.211263:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566208 00000100:00100000:3.0:1783562277.211295:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562277.211303:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fd37210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:5735:x1870200563566208:12345-0@lo:101: 00010000:00010000:3.0:1783562277.211312:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562277.211326:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87b92 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.211344:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.211354:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562277.211363:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000736a6a19, rc 0) 00000100:00100000:3.0:1783562277.211397:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fd37210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566208:12345-0@lo:101: Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562277.211458:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566208:0@lo:101: 00010000:00010000:2.0:1783562277.211472:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.211480:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562277.211512:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783562277.211533:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566336:0@lo:501: 00000100:00100000:2.0:1783562277.211564:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.211587:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.211599:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566336 00000100:00100000:1.0:1783562277.211605:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566336 00000100:00100000:1.0:1783562277.211635:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562277.211642:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062cb0358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566336:12345-0@lo:501: 00000100:00100000:1.0:1783562277.212529:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062cb0358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566336:12345-0@lo:501: Request processed in 886us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.212536:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783562277.212558:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566336:0@lo:501: 00000100:00100000:2.0:1783562277.212591:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566464:0@lo:503: 00000100:00100000:2.0:1783562277.212632:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.212660:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.212685:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566464 00000100:00100000:3.0:1783562277.212692:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566464 00000100:00100000:3.0:1783562277.212725:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783562277.212734:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9e7d137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566464:12345-0@lo:503: 00000040:00080000:3.0:1783562277.212779:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783562277.212825:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9e7d137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566464:12345-0@lo:503: Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562277.212832:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783562277.212850:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566464:0@lo:503: 00000040:00080000:0.0:1783562277.213666:0:5781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783562277.214099:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783562277.214121:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783562277.214138:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.214150:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562277.214192:0:5735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783562277.214195:0:5735:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcc78df800 10000000:01000000:2.0:1783562277.214199:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcc78df800 10000000:01000000:2.0:1783562277.214203:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783562277.214215:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc78df800 from 1 10000000:01000000:2.0:1783562277.214217:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783562277.214241:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.214247:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.214253:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.214263:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566592:0@lo:101: 00000100:00100000:2.0:1783562277.214302:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.214338:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.214374:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566592 00000100:00100000:1.0:1783562277.214381:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566592 00000100:00100000:1.0:1783562277.214432:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562277.214440:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002823d324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563566592:12345-0@lo:101: 00010000:00010000:1.0:1783562277.214452:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562277.214477:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87ba0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.214507:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.214519:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.214528:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007fd92f2, rc 0) 00000100:00100000:1.0:1783562277.214563:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002823d324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563566592:12345-0@lo:101: Request processed in 124us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.214570:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783562277.214584:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566592:0@lo:101: 00010000:00010000:2.0:1783562277.214600:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.214620:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.214657:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566720:0@lo:501: 00000100:00100000:2.0:1783562277.214675:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.214699:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.214738:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566720 00000100:00100000:3.0:1783562277.214744:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566720 00000100:00100000:3.0:1783562277.214811:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562277.214819:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b3b388f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563566720:12345-0@lo:501: 00000100:00100000:3.0:1783562277.215081:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b3b388f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563566720:12345-0@lo:501: Request processed in 264us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562277.215087:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783562277.215146:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566720:0@lo:501: 00000100:00100000:2.0:1783562277.215169:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566848:0@lo:503: 00000100:00100000:2.0:1783562277.215197:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.215212:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037bc1a31 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.215235:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566848 00000100:00100000:1.0:1783562277.215254:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566848 00000100:00100000:1.0:1783562277.215281:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783562277.215287:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c1aa5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563566848:12345-0@lo:503: 00000100:00100000:1.0:1783562277.215730:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c1aa5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563566848:12345-0@lo:503: Request processed in 442us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.215740:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783562277.215753:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038c9f13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563566848:0@lo:503: 00000100:00100000:0.0:1783562277.216211:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0aa99aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5782:1870200563566976:0@lo:502: 00000100:00100000:0.0:1783562277.216257:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562277.216295:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa4a8c08 going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.216311:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563566976 00000100:00100000:3.0:1783562277.216317:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563566976 00000100:00100000:3.0:1783562277.216358:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783562277.216365:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015cdbc5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5782:x1870200563566976:12345-0@lo:502: 00000100:00100000:3.0:1783562277.216639:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015cdbc5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5782:x1870200563566976:12345-0@lo:502: Request processed in 274us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562277.216647:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783562277.216710:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0aa99aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5782:1870200563566976:0@lo:502: 00000020:01000004:0.0:1783562277.216762:0:5782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783562277.216779:0:5782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d7576546) 00000020:00000080:0.0:1783562277.216798:0:5782:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783562277.217057:0:5782:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039b156b0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783562277.217062:0:5782:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000039b156b0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783562277.217064:0:5782:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000039b156b0 4 00010000:00080000:0.0:1783562277.217094:0:5782:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e179eb8c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:0.0:1783562277.218969:0:5782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1783562277.219085:0:5782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783562277.219120:0:5782:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783562277.219131:0:5782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4738ba0933b87bb5 00000100:00080000:0.0:1783562277.219142:0:5782:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783562277.219147:0:5782:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e179eb8c using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562277.219182:0:5782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0aa99aa x1870200563567104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783562277.219205:0:5782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783562277.219241:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0aa99aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563567104:0@lo:38: 00000100:00100000:3.0:1783562277.219332:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562277.219719:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567104 00000100:00100000:0.0:1783562277.219726:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567104 00000100:00100000:0.0:1783562277.219762:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562277.219768:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd37024f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563567104:12345-0@lo:38: 00000100:00100000:0.0:1783562277.219830:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd37024f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563567104:12345-0@lo:38: Request processed in 61us (498us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783562277.219838:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562277.219956:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783562277.219971:0:3271:0:(import.c:65:import_set_state_nolock()) 00000000e179eb8c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783562277.219975:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783562277.219979:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0aa99aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563567104:0@lo:38: 00000100:00100000:0.0:1783562277.220070:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5782:1870200563567232:0@lo:502: 00000100:00100000:0.0:1783562277.220113:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562277.220131:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa4a8c08 going to sleep for 11 seconds 00000100:00100000:1.0:1783562277.220187:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567232 00000100:00100000:1.0:1783562277.220191:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567232 00000100:00100000:1.0:1783562277.220224:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562277.220230:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7887e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5782:x1870200563567232:12345-0@lo:502: 00000100:00100000:1.0:1783562277.220526:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7887e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5782:x1870200563567232:12345-0@lo:502: Request processed in 296us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.220533:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783562277.220699:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5782:1870200563567232:0@lo:502: 00000040:00080000:0.0:1783562277.220725:0:5782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783562277.220786:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783562277.220816:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783562277.220837:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.220850:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783562277.220901:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783562277.220903:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562277.220904:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562277.220906:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562277.220906:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562277.220917:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562277.220918:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562277.220920:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562277.220921:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562277.220922:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562277.220924:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562277.220925:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562277.220929:0:5735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783562277.220931:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783562277.220932:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562277.220933:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562277.220934:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562277.220935:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562277.220936:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562277.220937:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562277.220938:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562277.220939:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562277.220940:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562277.220941:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562277.220942:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562277.220955:0:5735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783562277.220961:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9cbe453 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563567360:0@lo:253: 00000100:00100000:2.0:1783562277.220989:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.221012:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000260884f3 going to sleep for 11 seconds 00000100:00100000:3.0:1783562277.221024:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567360 00000100:00100000:3.0:1783562277.221029:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567360 00000100:00100000:3.0:1783562277.221061:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783562277.221068:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059a9dffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5735:x1870200563567360:12345-0@lo:253: 20000000:01000000:3.0:1783562277.221099:0:5750:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783562277.221125:0:5750:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783562277.237501:0:5750:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783562277.237526:0:5750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783562277.237593:0:5770:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783562277.237600:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783562277.237624:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.237648:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.237657:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.237702:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.237718:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 12 pid: 5750 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562277.237754:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b1bcee3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5770:1870200563567488:0@lo:104: 00000100:00100000:1.0:1783562277.237836:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.237879:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567488 00000100:00100000:2.0:1783562277.237889:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567488 00000100:00100000:2.0:1783562277.237978:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562277.237989:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005218d275 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5770:x1870200563567488:12345-0@lo:104: 00000100:00100000:1.0:1783562277.237991:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000adf93164 going to sleep for 11 seconds 00010000:00010000:2.0:1783562277.238007:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238077:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783562277.238084:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005218d275 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5770:x1870200563567488:12345-0@lo:104: Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562277.238091:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b1bcee3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5770:1870200563567488:0@lo:104: 00000100:00100000:2.0:1783562277.238095:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783562277.238097:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562277.238103:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.238111:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000077f89f8a already unused, calling callback (000000007160f69b) 10000000:00010000:0.0:1783562277.238114:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.238117:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.238154:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562277.238162:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562277.238168:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783562277.238198:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.238206:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562277.238227:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.238233:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 0000000077f89f8a/0x4738ba0933b87b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b8b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562277.238251:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562277.238253:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562277.238254:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562277.238317:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563567616:0@lo:103: 00000100:00100000:1.0:1783562277.238360:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562277.238392:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567616 00000100:00100000:2.0:1783562277.238397:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567616 00010000:00010000:2.0:1783562277.238506:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 13 pid: 5750 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.238536:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562277.238542:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b1bcee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:3273:x1870200563567616:12345-0@lo:103: 00010000:00010000:2.0:1783562277.238554:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562277.238559:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 13 pid: 5750 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238570:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 13 pid: 5750 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238583:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000772cad98/0x4738ba0933b87b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87b84 expref: 13 pid: 5750 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238598:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238615:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783562277.238630:0:5739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001031358s 00010000:00010000:2.0:1783562277.238634:0:5739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238641:0:5739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238648:0:5739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238654:0:5739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238660:0:5739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046d18331 already unused, calling callback (0000000084a47c21) 00010000:00010000:2.0:1783562277.238663:0:5739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238670:0:5739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238685:0:5739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562277.238696:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562277.238708:0:5770:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.238717:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562277.238724:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046d18331/0x4738ba0933b87bbc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562277.238730:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b1bcee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:3273:x1870200563567616:12345-0@lo:103: Request processed in 187us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562277.238740:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562277.238744:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563567616:0@lo:103: 00000100:00100000:3.0:1783562277.242896:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059a9dffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5735:x1870200563567360:12345-0@lo:253: Request processed in 21817us (21893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562277.242932:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783562277.242942:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9cbe453 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5735:1870200563567360:0@lo:253: 10000000:01000000:2.0:1783562277.242962:0:5735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783562277.242965:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783562277.242967:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562277.242969:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562277.242970:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562277.242972:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562277.242973:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562277.242975:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562277.242977:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562277.242978:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562277.242980:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562277.242982:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562277.242983:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783562277.243004:0:5735:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783562277.249109:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562277.249550:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562277.249799:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562277.249978:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562277.250184:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562277.250348:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562277.251139:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.251447:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562277.251683:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.251872:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562277.252109:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562277.252388:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1783562277.277123:0:5735:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783562277.296495:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783562277.296509:0:5787:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783562277.296514:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783562277.296696:0:5788:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783562277.300837:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783562277.301455:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783562277.301837:0:5735:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783562277.301844:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783562277.302006:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562277.302771:0:5735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783562277.303197:0:5735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783562277.303230:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783562277.303472:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783562277.303730:0:5735:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1783562277.304958:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783562277.305144:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783562277.305315:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783562277.305479:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783562277.305734:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783562277.305884:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783562277.306133:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783562277.306272:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783562277.306440:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783562277.306576:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783562277.306725:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783562277.306810:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783562277.306940:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783562277.307183:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783562277.307331:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783562277.307570:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783562277.308144:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783562277.308445:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783562277.308768:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783562277.308971:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783562277.309211:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783562277.309450:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783562277.309646:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783562277.309872:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783562277.310153:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783562277.310431:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783562277.310634:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783562277.310865:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783562277.311129:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783562277.311307:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783562277.311600:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783562277.311777:0:5735:0:(lfsck_lib.c:2689:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783562277.312022:0:5735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783562277.324652:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783562277.345069:0:5735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783562277.345104:0:5735:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac9e01cbb988 00100000:10000000:0.0:1783562277.345125:0:5735:0:(lfsck_lib.c:3088:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783562277.346249:0:5735:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783562277.346267:0:5735:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783562277.346280:0:5735:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1783562277.346314:0:5735:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1783562277.367459:0:5788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783562277.367565:0:5788:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783562277.367571:0:5788:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1783562277.815191:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562278.838700:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562279.256752:0:6030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783562279.863516:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562280.886608:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562281.911535:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562282.258631:0:6231:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed80cc2d0 20000000:00000080:2.0:1783562282.258645:0:6231:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcc5c04000 uarg=0000000000000000 20000000:01000000:2.0:1783562282.258671:0:6231:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783562282.258676:0:6231:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783562282.258680:0:6231:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783562282.258846:0:6231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1783562282.258856:0:6231:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783562282.262781:0:6231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562282.263087:0:6231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783562282.263149:0:6231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783562282.263208:0:6231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783562282.263228:0:6231:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783562282.263249:0:6231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562282.263298:0:6231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562282.263355:0:6231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562282.263396:0:6231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562282.263510:0:6231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 10 pid: 5750 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562282.263525:0:6231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9cbe453 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6231:1870200563567744:0@lo:104: 00000100:00100000:2.0:1783562282.263588:0:6231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562282.263652:0:6231:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054d6c0ab going to sleep for 11 seconds 00000100:00100000:1.0:1783562282.263719:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567744 00000100:00100000:1.0:1783562282.263727:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567744 00000100:00100000:1.0:1783562282.263777:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562282.263785:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008db9a9bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:6231:x1870200563567744:12345-0@lo:104: 00010000:00010000:1.0:1783562282.263804:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562282.263932:0:6231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9cbe453 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6231:1870200563567744:0@lo:104: 00010000:00010000:2.0:1783562282.263950:0:6231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562282.264015:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783562282.264022:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008db9a9bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:6231:x1870200563567744:12345-0@lo:104: Request processed in 238us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562282.264030:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783562282.264080:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562282.264086:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264094:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0bf28bc already unused, calling callback (000000007160f69b) 10000000:00010000:3.0:1783562282.264097:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264104:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562282.264110:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562282.264115:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783562282.264155:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264163:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783562282.264246:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000565b646d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563567872:0@lo:103: 00000100:00100000:2.0:1783562282.264274:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562282.264359:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563567872 00000100:00100000:0.0:1783562282.264364:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563567872 00010000:00010000:0.0:1783562282.264381:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562282.264426:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562282.264432:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cbe453 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:3274:x1870200563567872:12345-0@lo:103: 00010000:00010000:0.0:1783562282.264450:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562282.264454:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264463:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264475:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000736a6a19/0x4738ba0933b87b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87b92 expref: 11 pid: 5750 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264490:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264496:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264507:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264514:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264520:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264525:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264530:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8d59c0b already unused, calling callback (0000000084a47c21) 00010000:00010000:0.0:1783562282.264533:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264550:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264563:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562282.264572:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562282.264683:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264690:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 00000000c0bf28bc/0x4738ba0933b87b92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b99 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264706:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562282.264707:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562282.264709:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562282.264736:0:6231:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264742:0:6231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562282.264748:0:6231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87bc3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562282.265705:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cbe453 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:3274:x1870200563567872:12345-0@lo:103: Request processed in 1271us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562282.265714:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562282.265769:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000565b646d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563567872:0@lo:103: 00000100:00080000:1.0:1783562282.359456:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783562282.359466:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783562282.359469:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e179eb8c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562282.359486:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e179eb8c using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562282.359582:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000810e42f2 x1870200563568000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783562282.359643:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563568000:0@lo:38: 00000100:00100000:3.0:1783562282.359724:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562282.359821:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568000 00000100:00100000:0.0:1783562282.359830:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568000 00000100:00100000:0.0:1783562282.359887:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562282.359903:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007977508d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3271:x1870200563568000:12345-0@lo:38: 00010000:00080000:0.0:1783562282.359929:0:5756:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 91 last 0 00000020:00000080:0.0:1783562282.359977:0:5756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4738ba0933b87bca 00000004:00100000:0.0:1783562282.360016:0:5756:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783562282.360420:0:5756:0:(import.c:65:import_set_state_nolock()) 000000002d74311d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562282.360503:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007977508d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1870200563568000:12345-0@lo:38: Request processed in 599us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562282.360511:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783562282.360664:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000810e42f2 x1870200563568000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783562282.360679:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783562282.360687:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783562282.360692:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783562282.360694:0:3271:0:(import.c:65:import_set_state_nolock()) 00000000e179eb8c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783562282.360699:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000810e42f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563568000:0@lo:38: 00010000:00010000:3.0:1783562282.935785:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562283.959512:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783562284.980463:0:6545:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783562284.980468:0:6545:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783562284.980606:0:6545:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000000e98ff70 00000020:01000004:2.0:1783562284.980621:0:6545:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783562284.980634:0:6545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783562284.980652:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000003f747f5e) 00000020:00000080:2.0:1783562284.980671:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1783562284.984529:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783562284.994923:0:6545:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783562284.995183:0:6545:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783562285.015206:0:6545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783562285.019722:0:6545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783562285.019757:0:6545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783562285.019832:0:6545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783562285.019869:0:6545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783562285.020253:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783562285.020264:0:6545:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783562285.020274:0:6545:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b87bd8 00000020:01000004:3.0:1783562285.020281:0:6545:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783562285.020301:0:6545:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783562285.020303:0:6545:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783562285.020309:0:6545:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783562285.020314:0:6545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783562285.020325:0:6545:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000fb20f7ab) 00000020:00000080:3.0:1783562285.020337:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1783562285.021536:0:6545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562285.021670:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562285.021675:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783562285.024925:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562285.024938:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783562285.025316:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562285.025327:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783562285.026716:0:6545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562285.026928:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783562285.026934:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783562285.027397:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783562285.027427:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783562285.045053:0:6545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562285.045283:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562285.045290:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783562285.046248:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562285.046256:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783562285.048727:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562285.048739:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783562285.051294:0:6545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562285.051493:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783562285.051499:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783562285.052115:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783562285.052122:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783562285.085927:0:6545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562285.086120:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783562285.086126:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783562285.087088:0:6545:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783562285.087102:0:6545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783562285.087497:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783562285.087521:0:6545:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783562285.087527:0:6545:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783562285.102808:0:6545:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783562285.102845:0:6545:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783562285.102849:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783562285.102851:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783562285.102852:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562285.102853:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562285.102854:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562285.102856:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562285.102858:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562285.102859:0:6545:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562285.102860:0:6545:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562285.102862:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562285.102863:0:6545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783562285.102867:0:6545:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783562285.102869:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783562285.102870:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783562285.102872:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562285.102873:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562285.102874:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562285.102875:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562285.102876:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562285.102877:0:6545:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562285.102878:0:6545:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562285.102879:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562285.102880:0:6545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783562285.102907:0:6545:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783562285.102930:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000032b3af81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563568128:0@lo:253: 00000100:00100000:2.0:1783562285.103012:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.103151:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0dfc99f going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.103270:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568128 00000100:00100000:1.0:1783562285.103278:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568128 00000100:00100000:1.0:1783562285.103364:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783562285.103372:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c16a9daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563568128:12345-0@lo:253: 20000000:01000000:1.0:1783562285.103428:0:5749:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783562285.103433:0:5749:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783562285.103437:0:5749:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783562285.103439:0:5749:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783562285.104254:0:5749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562285.104457:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1783562285.104471:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783562285.104507:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1783562285.104515:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783562285.104542:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1783562285.104587:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1783562285.104871:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1783562285.104888:0:5749:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.104@tcp 20000000:01000000:1.0:1783562285.104890:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.104@tcp (null) (null) (null) 00000040:00080000:1.0:1783562285.104929:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1783562285.104937:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783562285.104980:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1783562285.104988:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.104@tcp (null) (null) 00000040:00080000:1.0:1783562285.105017:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1783562285.105025:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783562285.105054:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1783562285.105098:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1783562285.105788:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783562285.105804:0:5749:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.104@tcp 20000000:01000000:1.0:1783562285.105806:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.104@tcp (null) (null) (null) 00000040:00080000:1.0:1783562285.105837:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783562285.105843:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783562285.105869:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783562285.105876:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.104@tcp (null) (null) 00000040:00080000:1.0:1783562285.105916:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783562285.105924:0:5749:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783562285.105952:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1783562285.105987:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1783562285.106000:0:5749:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783562285.106003:0:5749:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783562285.106007:0:5749:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783562285.106017:0:5749:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783562285.106019:0:5749:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783562285.106047:0:5749:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783562285.106049:0:5749:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783562285.106845:0:6560:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1783562285.106892:0:6560:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1783562285.106949:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1783562285.107213:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1783562285.107249:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1783562285.107316:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1783562285.107328:0:5749:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783562285.107329:0:5749:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783562285.107866:0:6561:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1783562285.107903:0:6561:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1783562285.107944:0:6561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1783562285.108153:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1783562285.108197:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1783562285.108230:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1783562285.108241:0:5749:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783562285.108243:0:5749:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783562285.108586:0:6562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783562285.108777:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1783562285.108812:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1783562285.108862:0:5749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1783562285.108877:0:5749:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1783562285.108879:0:5749:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1783562285.108888:0:5749:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783562285.108907:0:5749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108926:0:5749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108933:0:5749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108939:0:5749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108946:0:5749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108984:0:5749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.108999:0:5749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 10 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.109012:0:5749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000639eff62 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568256:0@lo:104: 00000100:00100000:1.0:1783562285.109087:0:5749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562285.109211:0:5749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.109219:0:5749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.109226:0:5749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b282191 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568384:0@lo:104: 00000100:00100000:1.0:1783562285.109247:0:5749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562285.109376:0:5749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.109384:0:5749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 10 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.109393:0:5749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a97b2f11 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568512:0@lo:104: 00000100:00100000:1.0:1783562285.109431:0:5749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.109497:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568256 00000100:00100000:2.0:1783562285.109504:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568256 00000100:00100000:2.0:1783562285.109533:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568384 00000100:00100000:2.0:1783562285.109535:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568384 00000100:00100000:2.0:1783562285.109546:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562285.109553:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bd4533b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:5749:x1870200563568256:12345-0@lo:104: 00010000:00010000:2.0:1783562285.109564:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.109613:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783562285.109618:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bd4533b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:5749:x1870200563568256:12345-0@lo:104: Request processed in 66us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.109625:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562285.109639:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783562285.109645:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f56e28b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5749:x1870200563568384:12345-0@lo:104: 00010000:00010000:2.0:1783562285.109650:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.109678:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783562285.109687:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f56e28b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5749:x1870200563568384:12345-0@lo:104: Request processed in 44us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.109693:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783562285.109743:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562285.109748:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109755:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f36381dd already unused, calling callback (000000007160f69b) 10000000:00010000:3.0:1783562285.109768:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109776:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562285.109792:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562285.109798:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562285.109824:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109831:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562285.109856:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109863:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 00000000f36381dd/0x4738ba0933b87ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ba7 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109875:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562285.109877:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109883:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c3ea72d already unused, calling callback (000000007160f69b) 10000000:00010000:3.0:1783562285.109885:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109890:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562285.109895:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562285.109900:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562285.109917:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109923:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562285.109936:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109942:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 000000009c3ea72d/0x4738ba0933b87b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b37 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.109952:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562285.109953:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562285.109955:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562285.109960:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562285.109974:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562285.109985:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009aa2793c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563568640:0@lo:103: 00000100:00100000:3.0:1783562285.110013:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.110046:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fca7067b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563568768:0@lo:103: 00000100:00100000:3.0:1783562285.110066:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.110098:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568640 00000100:00100000:3.0:1783562285.110101:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568640 00010000:00010000:3.0:1783562285.110122:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 11 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.110143:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568768 00000100:00100000:1.0:1783562285.110145:0:5749:0:(client.c:2702:ptlrpc_set_wait()) set 000000001a0753f1 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.110147:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568768 00010000:00010000:3.0:1783562285.110160:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 12 pid: 5748 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.110163:0:5749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000639eff62 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568256:0@lo:104: 00000100:00100000:1.0:1783562285.110174:0:5749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b282191 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568384:0@lo:104: 00000100:00100000:3.0:1783562285.110185:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562285.110193:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c7dee9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:3274:x1870200563568640:12345-0@lo:103: 00010000:00010000:3.0:1783562285.110208:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562285.110213:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 12 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110222:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 12 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110232:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007fd92f2/0x4738ba0933b87ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87ba0 expref: 12 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110243:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562285.110269:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568512 00000100:00100000:0.0:1783562285.110275:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568512 00000100:00100000:3.0:1783562285.110276:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c7dee9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:3274:x1870200563568640:12345-0@lo:103: Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.110286:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562285.110306:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562285.110310:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562285.110314:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef176694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:3272:x1870200563568768:12345-0@lo:103: 00010000:00010000:3.0:1783562285.110332:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562285.110336:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110343:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110352:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d75cfa5/0x4738ba0933b87b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87b30 expref: 10 pid: 5748 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.110359:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000939a42e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5749:x1870200563568512:12345-0@lo:104: 00010000:00010000:3.0:1783562285.110364:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562285.110370:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.110439:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef176694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:3272:x1870200563568768:12345-0@lo:103: Request processed in 128us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.110446:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783562285.110450:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562285.110459:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000939a42e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5749:x1870200563568512:12345-0@lo:104: Request processed in 104us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.110467:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562285.110494:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009aa2793c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563568640:0@lo:103: 00000100:00100000:0.0:1783562285.110504:0:5749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a97b2f11 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5749:1870200563568512:0@lo:104: 00010000:00010000:0.0:1783562285.110531:0:5749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110532:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562285.110539:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110549:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cd128ba3 already unused, calling callback (000000007160f69b) 10000000:00010000:3.0:1783562285.110551:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110558:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562285.110563:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562285.110569:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562285.110592:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110598:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562285.110607:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110614:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 00000000cd128ba3/0x4738ba0933b87b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87b1b expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.110630:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562285.110632:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562285.110634:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562285.110644:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009aa2793c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563568896:0@lo:103: 00000100:00100000:3.0:1783562285.110675:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.110810:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563568896 00000100:00100000:0.0:1783562285.110815:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563568896 00010000:00010000:0.0:1783562285.110830:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 9 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.110864:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fca7067b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563568768:0@lo:103: 00000100:00100000:0.0:1783562285.110873:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562285.110883:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089b2407c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:3273:x1870200563568896:12345-0@lo:103: 00010000:00010000:0.0:1783562285.110891:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562285.110895:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 9 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110903:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 9 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110913:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001662a13e/0x4738ba0933b87b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87b14 expref: 9 pid: 5749 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110924:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110930:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110941:0:5739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110948:0:5739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110953:0:5739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110959:0:5739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110973:0:5739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000089fa2a8f already unused, calling callback (0000000084a47c21) 00010000:00010000:0.0:1783562285.110977:0:5739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.110983:0:5739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.111231:0:5749:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.111240:0:5749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562285.111247:0:5749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1783562285.111292:0:5739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.111300:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089fa2a8f/0x4738ba0933b87be6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.111313:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562285.111671:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089b2407c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:3273:x1870200563568896:12345-0@lo:103: Request processed in 790us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.111681:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562285.111843:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009aa2793c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563568896:0@lo:103: 00000100:00100000:2.0:1783562285.137126:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c16a9daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:6545:x1870200563568128:12345-0@lo:253: Request processed in 33748us (34107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.137146:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783562285.137163:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000032b3af81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563568128:0@lo:253: 10000000:01000000:0.0:1783562285.137180:0:6545:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783562285.137182:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783562285.137183:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783562285.137184:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562285.137185:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1783562285.137186:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562285.137187:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562285.137187:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562285.137189:0:6545:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783562285.137190:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562285.137191:0:6545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783562285.137210:0:6545:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000e98ff70 from lustre-OST0000 10000000:01000000:0.0:1783562285.137231:0:6545:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783562285.137244:0:6545:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783562285.137249:0:6545:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfcc3f199c0 local copy 10000000:01000000:0.0:1783562285.137311:0:6545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783562285.137347:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.137358:0:6545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.137367:0:6545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.137381:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569024:0@lo:101: 00000100:00100000:0.0:1783562285.137425:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.137463:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569024 00000100:00100000:1.0:1783562285.137470:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569024 00000100:00100000:1.0:1783562285.137511:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783562285.137517:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a9757fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:6545:x1870200563569024:12345-0@lo:101: 00010000:00010000:1.0:1783562285.137530:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562285.137542:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001da59dd5/0x4738ba0933b87bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87bed expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.137563:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001da59dd5/0x4738ba0933b87bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87bed expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.137573:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001da59dd5/0x4738ba0933b87bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87bed expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.137581:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001da59dd5, rc 0) 00000100:00100000:1.0:1783562285.137605:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a9757fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:6545:x1870200563569024:12345-0@lo:101: Request processed in 89us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.137606:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000009ff7a341 going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.137611:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783562285.137617:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569024:0@lo:101: 00010000:00010000:0.0:1783562285.137627:0:6545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.137635:0:6545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.137723:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569152:0@lo:501: 00000100:00100000:0.0:1783562285.137778:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.137788:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000009ff7a341 going to sleep for 11 seconds 00000100:00100000:2.0:1783562285.137949:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569152 00000100:00100000:2.0:1783562285.137953:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569152 00000100:00100000:2.0:1783562285.138014:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783562285.138020:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042551544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:6545:x1870200563569152:12345-0@lo:501: 00000100:00100000:2.0:1783562285.138216:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042551544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:6545:x1870200563569152:12345-0@lo:501: Request processed in 197us (437us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783562285.138223:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783562285.138288:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569152:0@lo:501: 10000000:01000000:0.0:1783562285.138300:0:6545:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783562285.138324:0:6545:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783562285.138328:0:6545:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.138341:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.138346:0:6545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.138371:0:6545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783562285.138387:0:6545:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcc7fb7800 10000000:01000000:0.0:1783562285.138392:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783562285.138396:0:6545:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bfcc3f199c0 10000000:01000000:0.0:1783562285.138398:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783562285.138423:0:6545:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9bfcc3f199c0 from 1 10000000:01000000:0.0:1783562285.138426:0:6545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783562285.138450:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138454:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562285.138458:0:6545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138459:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.138465:0:6545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138466:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000124e7d39 already unused, calling callback (000000007160f69b) 10000000:00010000:1.0:1783562285.138469:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.138475:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569280:0@lo:101: 00010000:00010000:1.0:1783562285.138476:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562285.138482:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562285.138492:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783562285.138498:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562285.138507:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138513:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562285.138531:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138537:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: 00000000124e7d39/0x4738ba0933b87bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87bf4 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.138553:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562285.138555:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562285.138556:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562285.138563:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783562285.138573:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000106a8167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563569408:0@lo:103: 00000100:00100000:1.0:1783562285.138598:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.138690:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000008589cb69 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.138723:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569280 00000100:00100000:3.0:1783562285.138727:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569280 00000100:00100000:3.0:1783562285.138748:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562285.138754:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c11c58a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:6545:x1870200563569280:12345-0@lo:101: 00010000:00010000:3.0:1783562285.138771:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562285.138780:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000657ff4d/0x4738ba0933b87c02 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87bfb expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.138794:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000657ff4d/0x4738ba0933b87c02 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87bfb expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.138803:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000657ff4d/0x4738ba0933b87c02 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87bfb expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.138809:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000657ff4d, rc 0) 00000100:00100000:3.0:1783562285.138844:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c11c58a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569280:12345-0@lo:101: Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.138851:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562285.138874:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569408 00000100:00100000:3.0:1783562285.138878:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569408 00000100:00100000:3.0:1783562285.138902:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.138908:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e8e04db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:3275:x1870200563569408:12345-0@lo:103: 00010000:00010000:3.0:1783562285.138915:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562285.138926:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001da59dd5/0x4738ba0933b87bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87bed expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.138937:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562285.138962:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e8e04db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:3275:x1870200563569408:12345-0@lo:103: Request processed in 55us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.138974:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.139000:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000106a8167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563569408:0@lo:103: 00000100:00100000:0.0:1783562285.139055:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569280:0@lo:101: 00010000:00010000:0.0:1783562285.139065:0:6545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.139081:0:6545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562285.139096:0:6545:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783562285.139112:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.139119:0:6545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 000000006bfe5aa2/0x4738ba0933b87bfb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562285.139126:0:6545:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783562285.139129:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783562285.139133:0:6545:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783562285.139135:0:6545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783562285.139147:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.139154:0:6545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.139161:0:6545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.139171:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569536:0@lo:101: 00000100:00100000:0.0:1783562285.139195:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.139216:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000008589cb69 going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.139355:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569536 00000100:00100000:1.0:1783562285.139359:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569536 00000100:00100000:2.0:1783562285.139620:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783562285.139629:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba89471a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+8:6545:x1870200563569536:12345-0@lo:101: 00010000:00010000:2.0:1783562285.139638:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562285.139648:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c09 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.139661:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.139669:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8d59c0b/0x4738ba0933b87c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.139676:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8d59c0b, rc 0) 00000100:00100000:2.0:1783562285.139748:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba89471a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569536:12345-0@lo:101: Request processed in 120us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.139773:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783562285.139810:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d282135a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569536:0@lo:101: 00010000:00010000:3.0:1783562285.139819:0:6545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.139826:0:6545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.139897:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569664:0@lo:501: 00000100:00100000:3.0:1783562285.139933:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.141781:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085abd4d3 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.141862:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569664 00000100:00100000:0.0:1783562285.141872:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569664 00000100:00100000:0.0:1783562285.141925:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783562285.141932:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e1d80e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569664:12345-0@lo:501: 00000100:00100000:0.0:1783562285.142393:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e1d80e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569664:12345-0@lo:501: Request processed in 460us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.142417:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783562285.142520:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569664:0@lo:501: 00000100:00100000:3.0:1783562285.142565:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569792:0@lo:503: 00000100:00100000:3.0:1783562285.142605:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.142632:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085abd4d3 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.142650:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569792 00000100:00100000:0.0:1783562285.142655:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569792 00000100:00100000:2.0:1783562285.142682:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783562285.142691:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d1ca156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569792:12345-0@lo:503: 00000100:00100000:2.0:1783562285.142863:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d1ca156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569792:12345-0@lo:503: Request processed in 175us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.142868:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783562285.142918:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569792:0@lo:503: 00000040:00080000:3.0:1783562285.143151:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783562285.143198:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569920:0@lo:502: 00000100:00100000:3.0:1783562285.143221:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.143237:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085abd4d3 going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.143252:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563569920 00000100:00100000:1.0:1783562285.143257:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563569920 00000100:00100000:1.0:1783562285.143384:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783562285.143392:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000833168e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569920:12345-0@lo:502: 00000100:00100000:1.0:1783562285.143551:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000833168e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563569920:12345-0@lo:502: Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.143557:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783562285.143583:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c1dec24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563569920:0@lo:502: 00000040:00080000:2.0:1783562285.143839:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783562285.143881:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783562285.143908:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783562285.143951:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783562285.143983:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783562285.144003:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783562285.144020:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030fab901 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570048:0@lo:502: 00000100:00100000:2.0:1783562285.144053:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.144123:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bcd69012 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.144163:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570048 00000100:00100000:0.0:1783562285.144167:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570048 00000100:00100000:0.0:1783562285.144193:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783562285.144200:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a32b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563570048:12345-0@lo:502: 00000100:00100000:2.0:1783562285.144535:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030fab901 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570048:0@lo:502: 00000100:00100000:0.0:1783562285.144558:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a32b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563570048:12345-0@lo:502: Request processed in 358us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.144565:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000040:00080000:2.0:1783562285.144608:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783562285.144617:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1783562285.146003:0:6564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783562285.146013:0:6564:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783562285.146020:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562285.146022:0:6564:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783562285.146028:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783562285.146043:0:6564:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000a725f915) 00000020:00000080:2.0:1783562285.146064:0:6564:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783562285.146069:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783562285.146368:0:6564:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000e98ff70 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783562285.146376:0:6564:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783562285.146383:0:6564:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b87c1e 00010000:00010000:2.0:1783562285.150928:0:6564:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1783562285.151225:0:6564:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783562285.154754:0:6564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783562285.155061:0:6564:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783562285.163217:0:6564:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783562285.164001:0:6564:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1783562285.165922:0:6564:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783562285.165933:0:6564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562285.165939:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562285.165942:0:6564:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783562285.165944:0:6564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562285.165949:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562285.165950:0:6564:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783562285.165953:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783562285.165955:0:6564:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783562285.166007:0:6564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562285.166012:0:6564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562285.166013:0:6564:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783562285.166016:0:6564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783562285.166180:0:6545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783562285.166207:0:6545:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783562285.166233:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.166246:0:6545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: 000000000d75cfa5/0x4738ba0933b87c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562285.166538:0:6545:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc7fb7800 from 1 10000000:01000000:0.0:1783562285.166541:0:6545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562285.166581:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: 000000001a48c036/0x4738ba0933b87c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.166589:0:6545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: 000000001a48c036/0x4738ba0933b87c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.166611:0:6545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: 000000001a48c036/0x4738ba0933b87c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.166632:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570176:0@lo:101: 00000100:00100000:0.0:1783562285.166702:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.166796:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c49f85c going to sleep for 11 seconds 00000100:00100000:2.0:1783562285.166881:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570176 00000100:00100000:2.0:1783562285.166889:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570176 00000100:00100000:2.0:1783562285.166972:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783562285.166982:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeba181a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+9:6545:x1870200563570176:12345-0@lo:101: 00010000:00010000:2.0:1783562285.166995:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562285.167009:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0bf28bc/0x4738ba0933b87c2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c25 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.167031:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0bf28bc/0x4738ba0933b87c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.167051:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0bf28bc/0x4738ba0933b87c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.167060:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0bf28bc, rc 0) 00000100:00100000:2.0:1783562285.167110:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeba181a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570176:12345-0@lo:101: Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.167118:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783562285.167188:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570176:0@lo:101: 00010000:00010000:0.0:1783562285.167202:0:6545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: 000000001a48c036/0x4738ba0933b87c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.167209:0:6545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: 000000001a48c036/0x4738ba0933b87c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.167946:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570304:0@lo:501: 00000100:00100000:0.0:1783562285.167980:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.168628:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570304 00000100:00100000:1.0:1783562285.168636:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570304 00000100:00100000:1.0:1783562285.168673:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783562285.168681:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcc0526c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570304:12345-0@lo:501: 00000100:00100000:1.0:1783562285.168911:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcc0526c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570304:12345-0@lo:501: Request processed in 231us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.168920:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783562285.169058:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c49f85c going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.169077:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570304:0@lo:501: 00000100:00100000:0.0:1783562285.169107:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570432:0@lo:503: 00000100:00100000:0.0:1783562285.169143:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.169166:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c49f85c going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.169225:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570432 00000100:00100000:1.0:1783562285.169230:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570432 00000100:00100000:1.0:1783562285.169344:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783562285.169351:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9692d20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570432:12345-0@lo:503: 00000100:00100000:1.0:1783562285.169794:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9692d20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570432:12345-0@lo:503: Request processed in 442us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.169801:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783562285.169863:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570432:0@lo:503: 00000040:00080000:0.0:1783562285.170149:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783562285.170215:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570560:0@lo:502: 00000100:00100000:0.0:1783562285.170244:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.170378:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c49f85c going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.170576:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570560 00000100:00100000:1.0:1783562285.170581:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570560 00000100:00100000:1.0:1783562285.170613:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783562285.170620:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060f12a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570560:12345-0@lo:502: 00000100:00100000:1.0:1783562285.170773:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060f12a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570560:12345-0@lo:502: Request processed in 154us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.170781:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783562285.170890:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570560:0@lo:502: 00000040:00080000:0.0:1783562285.171115:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783562285.171164:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783562285.171187:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570688:0@lo:502: 00000100:00100000:0.0:1783562285.171223:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.171367:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c49f85c going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.171570:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570688 00000100:00100000:1.0:1783562285.171575:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570688 00000100:00100000:1.0:1783562285.171638:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783562285.171645:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8eaca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570688:12345-0@lo:502: 00000100:00100000:1.0:1783562285.171775:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8eaca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570688:12345-0@lo:502: Request processed in 130us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.171782:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783562285.171842:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eae5b6b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570688:0@lo:502: 00000040:00080000:2.0:1783562285.171939:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783562285.171951:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783562285.172716:0:6568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562285.172726:0:6568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562285.172729:0:6568:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783562285.172736:0:6568:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc7fb7800 00000020:00000080:0.0:1783562285.172739:0:6568:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783562285.172788:0:6568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562285.172792:0:6568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562285.172794:0:6568:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783562285.172797:0:6568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783562285.172907:0:6545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783562285.172926:0:6545:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783562285.172946:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.172958:0:6545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562285.173000:0:6545:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783562285.173004:0:6545:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcc7fb7800 10000000:01000000:2.0:1783562285.173008:0:6545:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcc7fb7800 10000000:01000000:2.0:1783562285.173012:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783562285.173018:0:6545:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc7fb7800 from 1 10000000:01000000:2.0:1783562285.173021:0:6545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783562285.173050:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.173058:0:6545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.173075:0:6545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562285.173091:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570816:0@lo:101: 00000100:00100000:2.0:1783562285.173128:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.173212:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570816 00000100:00100000:3.0:1783562285.173219:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570816 00000100:00100000:2.0:1783562285.173229:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.173264:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783562285.173273:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+10:6545:x1870200563570816:12345-0@lo:101: 00010000:00010000:3.0:1783562285.173290:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562285.173303:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c33 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.173326:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.173338:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.173346:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c8600, rc 0) 00000100:00100000:3.0:1783562285.173388:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563570816:12345-0@lo:101: Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.173395:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783562285.173699:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570816:0@lo:101: 00010000:00010000:3.0:1783562285.173715:0:6545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.173724:0:6545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.173821:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570944:0@lo:501: 00000100:00100000:3.0:1783562285.173853:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.173880:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563570944 00000100:00100000:3.0:1783562285.173885:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563570944 00000100:00100000:3.0:1783562285.173909:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783562285.173915:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563570944:12345-0@lo:501: 00000100:00100000:3.0:1783562285.174284:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563570944:12345-0@lo:501: Request processed in 367us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.174296:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783562285.174330:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21850c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.174345:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563570944:0@lo:501: 00000100:00100000:3.0:1783562285.174374:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571072:0@lo:503: 00000100:00100000:3.0:1783562285.174448:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.174613:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.174622:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571072 00000100:00100000:0.0:1783562285.174628:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571072 00000100:00100000:0.0:1783562285.174657:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783562285.174664:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571072:12345-0@lo:503: 00000100:00100000:0.0:1783562285.174809:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571072:12345-0@lo:503: Request processed in 144us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.174817:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783562285.174837:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571072:0@lo:503: 00000040:00080000:3.0:1783562285.175298:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783562285.175356:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571200:0@lo:502: 00000100:00100000:3.0:1783562285.175399:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.175449:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.175548:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571200 00000100:00100000:0.0:1783562285.175552:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571200 00000100:00100000:0.0:1783562285.175584:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783562285.175591:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571200:12345-0@lo:502: 00000100:00100000:0.0:1783562285.175742:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571200:12345-0@lo:502: Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.175749:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783562285.175799:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571200:0@lo:502: 00000040:00080000:3.0:1783562285.176274:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783562285.176321:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783562285.176355:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783562285.176398:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783562285.176457:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783562285.176532:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783562285.176569:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783562285.177098:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783562285.177162:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783562285.177200:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783562285.177232:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783562285.177283:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783562285.177321:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783562285.177353:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783562285.177398:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783562285.177550:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783562285.177785:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783562285.177855:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783562285.177891:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783562285.177923:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783562285.177985:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783562285.178191:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783562285.178232:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783562285.178283:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783562285.178319:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1783562285.178353:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1783562285.178488:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1783562285.178542:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1783562285.178800:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571328:0@lo:502: 00000100:00100000:3.0:1783562285.178917:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.179016:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21850c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.179167:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571328 00000100:00100000:1.0:1783562285.179180:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571328 00000100:00100000:1.0:1783562285.179232:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783562285.179240:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571328:12345-0@lo:502: 00000100:00100000:1.0:1783562285.179798:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571328:12345-0@lo:502: Request processed in 557us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562285.179807:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783562285.179936:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571328:0@lo:502: 00000040:00080000:3.0:1783562285.180137:0:6545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1783562285.180148:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1783562285.182602:0:6569:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783562285.182620:0:6569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bfcc5cf8000) 00000020:00000080:3.0:1783562285.182641:0:6569:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1783562285.182824:0:6569:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcc7fb7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783562285.182829:0:6569:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcc7fb7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783562285.182831:0:6569:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc7fb7800 3 00010000:00080000:3.0:1783562285.182859:0:6569:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfbc6c2f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.104@tcp at head 00010000:00010000:3.0:1783562285.185963:0:6569:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783562285.186064:0:6569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783562285.186106:0:6569:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783562285.187211:0:6569:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4738ba0933b87c48 00000100:00080000:3.0:1783562285.187232:0:6569:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562285.187239:0:6569:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bfbc6c2f000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562285.187277:0:6569:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcc7e29880 x1870200563571456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783562285.187299:0:6569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783562285.187466:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563571584:0@lo:400: 00000100:00100000:3.0:1783562285.187528:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.187706:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563571456:0@lo:38: 00000100:00100000:0.0:1783562285.187743:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.187834:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571584 00000100:00100000:3.0:1783562285.187841:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571584 00000100:00100000:3.0:1783562285.187902:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571456 00000100:00100000:3.0:1783562285.187906:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571456 00000100:00100000:3.0:1783562285.187921:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.187931:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563571584:12345-0@lo:400: 00000100:00100000:1.0:1783562285.187999:0:5756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783562285.188006:0:5756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783562285.188007:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563571584:12345-0@lo:400: Request processed in 76us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.188018:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.188033:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562285.188037:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3271:x1870200563571456:12345-0@lo:38: 00010000:00080000:3.0:1783562285.188058:0:5755:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 94 last 0 00000020:00000080:3.0:1783562285.188094:0:5755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4738ba0933b87c4f 00000004:00100000:3.0:1783562285.188108:0:5755:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783562285.188138:0:5755:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c28000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562285.188189:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1870200563571456:12345-0@lo:38: Request processed in 149us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.188196:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783562285.188290:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcf7120700 x1870200563571584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562285.188314:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563571584:0@lo:400: 00010000:00080000:3.0:1783562285.188354:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcc7e29880 x1870200563571456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562285.188362:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783562285.188368:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783562285.188376:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783562285.188380:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783562285.188383:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783562285.188390:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563571456:0@lo:38: 00000040:00080000:3.0:1783562285.188481:0:6569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783562285.188751:0:6545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783562285.188789:0:6545:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783562285.188814:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.188827:0:6545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783562285.188876:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783562285.188878:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783562285.188879:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562285.188881:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562285.188882:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562285.188884:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562285.188885:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562285.188887:0:6545:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562285.188888:0:6545:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562285.188890:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562285.188891:0:6545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562285.188895:0:6545:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783562285.188897:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783562285.188899:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783562285.188900:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562285.188901:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562285.188902:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562285.188903:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562285.188904:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562285.188909:0:6545:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783562285.188910:0:6545:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783562285.188911:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562285.188912:0:6545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562285.188929:0:6545:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783562285.188940:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571712:0@lo:253: 00000100:00100000:2.0:1783562285.188983:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.189016:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562285.189152:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571712 00000100:00100000:1.0:1783562285.189158:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571712 00000100:00100000:1.0:1783562285.189192:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562285.189201:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571712:12345-0@lo:253: 20000000:01000000:1.0:1783562285.189223:0:5749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783562285.189238:0:5749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783562285.208696:0:5749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783562285.208751:0:5749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783562285.209195:0:5770:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783562285.209200:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783562285.209225:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209243:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783562285.209254:0:5770:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001031358s 00010000:00010000:3.0:1783562285.209259:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209267:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209273:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209299:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209306:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562285.209311:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209319:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209332:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209339:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.209346:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfd020c8800/0x4738ba0933b87c56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562285.215937:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:6545:x1870200563571712:12345-0@lo:253: Request processed in 26729us (26945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.215951:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783562285.215984:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6545:1870200563571712:0@lo:253: 10000000:01000000:0.0:1783562285.215999:0:6545:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783562285.216003:0:6545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783562285.216004:0:6545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783562285.216006:0:6545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562285.216007:0:6545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562285.216008:0:6545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562285.216010:0:6545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562285.216011:0:6545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562285.216012:0:6545:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562285.216013:0:6545:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562285.216015:0:6545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562285.216016:0:6545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783562285.216032:0:6545:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783562285.221052:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562285.221483:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562285.221680:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562285.221880:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562285.222072:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562285.222299:0:6545:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783562285.223192:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783562285.340162:0:6545:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783562285.340170:0:6545:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783562285.340202:0:6545:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783562285.340254:0:6545:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783562285.340267:0:6545:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783562285.340303:0:6545:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:3.0:1783562285.630832:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783562285.630843:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc78df800 from 21 10000000:01000000:3.0:1783562285.630849:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562285.630914:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.630931:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.630946:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.630993:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563571840:0@lo:101: 00000100:00100000:3.0:1783562285.631262:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.631383:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185900 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.631735:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571840 00000100:00100000:0.0:1783562285.631745:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571840 00000100:00100000:0.0:1783562285.631835:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783562285.631847:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:5752:x1870200563571840:12345-0@lo:101: 00010000:00010000:0.0:1783562285.631875:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562285.631893:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c5d expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.631926:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.631938:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.631948:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030c00, rc 0) 00000100:00100000:0.0:1783562285.632126:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563571840:12345-0@lo:101: Request processed in 280us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.632134:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783562285.633364:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563571840:0@lo:101: 00010000:00010000:3.0:1783562285.633392:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.633422:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.633527:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563571968:0@lo:501: 00000100:00100000:3.0:1783562285.633589:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.633638:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562285.633666:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563571968 00000100:00100000:2.0:1783562285.633673:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563571968 00000100:00100000:2.0:1783562285.633725:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783562285.633737:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563571968:12345-0@lo:501: 00000100:00100000:2.0:1783562285.634107:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563571968:12345-0@lo:501: Request processed in 372us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.634116:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783562285.634198:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563571968:0@lo:501: 00000100:00100000:3.0:1783562285.634228:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572096:0@lo:503: 00000100:00100000:3.0:1783562285.634268:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.634294:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185900 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.634338:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572096 00000100:00100000:0.0:1783562285.634344:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572096 00000100:00100000:0.0:1783562285.634377:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783562285.634394:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563572096:12345-0@lo:503: 00000100:00100000:0.0:1783562285.634634:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563572096:12345-0@lo:503: Request processed in 249us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.634642:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783562285.634728:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572096:0@lo:503: 00000100:00100000:3.0:1783562285.635162:0:6603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6603:1870200563572224:0@lo:502: 00000100:00100000:3.0:1783562285.635204:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.635275:0:6603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562285.635308:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572224 00000100:00100000:2.0:1783562285.635313:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572224 00000100:00100000:2.0:1783562285.635378:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783562285.635387:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:6603:x1870200563572224:12345-0@lo:502: 00000100:00100000:2.0:1783562285.635859:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:6603:x1870200563572224:12345-0@lo:502: Request processed in 471us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.635868:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783562285.635961:0:6603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6603:1870200563572224:0@lo:502: 00000100:00100000:3.0:1783562285.636023:0:6603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6603:1870200563572352:0@lo:502: 00000100:00100000:3.0:1783562285.636134:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.636232:0:6603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185840 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.636396:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572352 00000100:00100000:0.0:1783562285.636431:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572352 00000100:00100000:0.0:1783562285.637206:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783562285.637220:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:6603:x1870200563572352:12345-0@lo:502: 00000100:00100000:0.0:1783562285.637577:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:6603:x1870200563572352:12345-0@lo:502: Request processed in 360us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.637587:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783562285.638285:0:6603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6603:1870200563572352:0@lo:502: 00000040:00080000:3.0:1783562285.638328:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1783562285.638599:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1783562285.638641:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783562285.638654:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.638669:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562285.638681:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783562285.638684:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcc78df800 from 3 10000000:01000000:0.0:1783562285.638688:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783562285.638729:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.638739:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.638764:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.638789:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572480:0@lo:101: 00000100:00100000:0.0:1783562285.638842:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.638881:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.639465:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572480 00000100:00100000:3.0:1783562285.639474:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572480 00000100:00100000:3.0:1783562285.639535:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783562285.639546:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563572480:12345-0@lo:101: 00010000:00010000:3.0:1783562285.639561:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562285.639586:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c6b expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.639619:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.639633:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.639644:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c9e00, rc 0) 00000100:00100000:3.0:1783562285.639702:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563572480:12345-0@lo:101: Request processed in 157us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.639709:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783562285.639808:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572480:0@lo:101: 00010000:00010000:0.0:1783562285.639833:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.639845:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562285.639917:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572608:0@lo:256: 00000100:00100000:0.0:1783562285.639977:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.640015:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.640196:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572608 00000100:00100000:3.0:1783562285.640203:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572608 00000100:00100000:3.0:1783562285.640246:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783562285.640256:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563572608:12345-0@lo:256: 20000000:01000000:3.0:1783562285.640275:0:5748:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783562285.640296:0:5748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783562285.640305:0:5748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783562285.640308:0:5748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:3.0:1783562285.640432:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563572608:12345-0@lo:256: Request processed in 177us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.640442:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783562285.640892:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572608:0@lo:256: 10000000:01000000:2.0:1783562285.640945:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783562285.640953:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.640969:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562285.640978:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783562285.640981:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1783562285.640984:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783562285.641009:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.641016:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.641025:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562285.641036:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572736:0@lo:101: 00000100:00100000:2.0:1783562285.641066:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.641129:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.643278:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572736 00000100:00100000:0.0:1783562285.643295:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572736 00000100:00100000:0.0:1783562285.643354:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783562285.643365:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563572736:12345-0@lo:101: 00010000:00010000:0.0:1783562285.643384:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562285.643421:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87c79 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.643452:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.643464:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.643475:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031000, rc 0) 00000100:00100000:0.0:1783562285.643553:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563572736:12345-0@lo:101: Request processed in 189us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.643562:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783562285.643578:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572736:0@lo:101: 00010000:00010000:2.0:1783562285.643596:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.643607:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562285.643674:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572864:0@lo:501: 00000100:00100000:2.0:1783562285.643707:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.643764:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.643765:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572864 00000100:00100000:3.0:1783562285.643771:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572864 00000100:00100000:3.0:1783562285.644563:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783562285.644577:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563572864:12345-0@lo:501: 00000100:00100000:3.0:1783562285.644911:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563572864:12345-0@lo:501: Request processed in 338us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.644918:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783562285.644994:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572864:0@lo:501: 00000100:00100000:1.0:1783562285.645033:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572992:0@lo:503: 00000100:00100000:1.0:1783562285.645075:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.645106:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.645113:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563572992 00000100:00100000:3.0:1783562285.645120:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563572992 00000100:00100000:3.0:1783562285.645185:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783562285.645194:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563572992:12345-0@lo:503: 00000100:00100000:3.0:1783562285.645441:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563572992:12345-0@lo:503: Request processed in 247us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.645448:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783562285.646635:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563572992:0@lo:503: 00000100:00100000:2.0:1783562285.647018:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6605:1870200563573120:0@lo:502: 00000100:00100000:2.0:1783562285.647069:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.647106:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.647169:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573120 00000100:00100000:3.0:1783562285.647183:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573120 00000100:00100000:3.0:1783562285.647217:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783562285.647226:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:6605:x1870200563573120:12345-0@lo:502: 00000100:00100000:3.0:1783562285.647511:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:6605:x1870200563573120:12345-0@lo:502: Request processed in 286us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.647519:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783562285.647904:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6605:1870200563573120:0@lo:502: 00000020:01000000:2.0:1783562285.647933:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783562285.647941:0:6605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783562285.647950:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562285.647952:0:6605:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783562285.647959:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783562285.647963:0:6605:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:2.0:1783562285.647985:0:6605:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783562285.647988:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783562285.648005:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bfcc6734d40) 00000020:00000080:2.0:1783562285.648026:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783562285.648032:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783562285.648101:0:6605:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783562285.648106:0:6605:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783562285.648112:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87c8e 00010000:00080000:2.0:1783562285.648150:0:6605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfceed15800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:2.0:1783562285.648320:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1783562285.669078:0:6605:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783562285.669109:0:6605:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783562285.669882:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562285.670030:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562285.670068:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783562285.670113:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1783562285.670776:0:6606:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783562285.670781:0:6606:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783562285.671510:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783562285.671521:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783562285.671549:0:6605:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783562285.671567:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b87c95 00000100:00080000:3.0:1783562285.671576:0:6605:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562285.671581:0:6605:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bfceed15800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562285.671613:0:6605:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcc7e29880 x1870200563573248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783562285.671629:0:6605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1783562285.671673:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563573248:0@lo:8: 00000020:01000000:3.0:1783562285.671682:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562285.671685:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562285.671687:0:6605:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783562285.671689:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562285.671693:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562285.671694:0:6605:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783562285.671696:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783562285.671698:0:6605:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783562285.671740:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.671804:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573248 00000100:00100000:3.0:1783562285.671811:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573248 00000100:00100000:3.0:1783562285.671849:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.671858:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3271:x1870200563573248:12345-0@lo:8: 00000100:00100000:0.0:1783562285.671864:0:6549:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783562285.671870:0:6549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1783562285.671880:0:6547:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 94 last 0 00000020:00000080:3.0:1783562285.671901:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b87c9c 00002000:00100000:3.0:1783562285.671925:0:6547:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bfbc6c2b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783562285.671934:0:6547:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1783562285.671938:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783562285.672076:0:6547:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783562285.672197:0:6547:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783562285.672217:0:6547:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c2d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562285.672271:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563573248:12345-0@lo:8: Request processed in 413us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.672278:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.672304:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6605:1870200563573376:0@lo:502: 00010000:00080000:0.0:1783562285.672450:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcc7e29880 x1870200563573248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562285.672453:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.672471:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562285.672478:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783562285.672484:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783562285.672492:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783562285.672495:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfceed15800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783562285.672500:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21859c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783562285.672506:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783562285.672511:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563573248:0@lo:8: 00000004:00080000:3.0:1783562285.672512:0:6606:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783562285.672593:0:6606:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 94929189771ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783562285.672636:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573376 00000100:00100000:2.0:1783562285.672640:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573376 00000100:00100000:2.0:1783562285.672694:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783562285.672701:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:6605:x1870200563573376:12345-0@lo:502: 00000100:00100000:2.0:1783562285.673068:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:6605:x1870200563573376:12345-0@lo:502: Request processed in 366us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562285.673083:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783562285.673137:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6605:1870200563573376:0@lo:502: 00000020:01000000:3.0:1783562285.673159:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562285.673164:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562285.673166:0:6605:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783562285.673170:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1783562285.673218:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1783562285.673231:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783562285.673240:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673250:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562285.673259:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783562285.673261:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc78df800 from 1 10000000:01000000:3.0:1783562285.673269:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783562285.673291:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673298:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673307:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.673803:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573504:0@lo:101: 00000100:00100000:3.0:1783562285.673830:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.673851:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21859c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.673865:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573504 00000100:00100000:3.0:1783562285.673869:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573504 00000100:00100000:3.0:1783562285.673888:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783562285.673895:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563573504:12345-0@lo:101: 00010000:00010000:3.0:1783562285.673903:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562285.673924:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87ca3 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673943:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673953:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.673962:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:3.0:1783562285.673987:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563573504:12345-0@lo:101: Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.674000:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783562285.674026:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573504:0@lo:101: 00010000:00010000:3.0:1783562285.674036:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562285.674045:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562285.674077:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573632:0@lo:501: 00000100:00100000:3.0:1783562285.674096:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.674108:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21859c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.674118:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573632 00000100:00100000:3.0:1783562285.674121:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573632 00000100:00100000:3.0:1783562285.674137:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783562285.674142:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563573632:12345-0@lo:501: 00000100:00100000:3.0:1783562285.674304:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563573632:12345-0@lo:501: Request processed in 161us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.674788:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783562285.674823:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573632:0@lo:501: 00000100:00100000:3.0:1783562285.674847:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573760:0@lo:503: 00000100:00100000:3.0:1783562285.674878:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.674890:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc21859c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.674902:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573760 00000100:00100000:3.0:1783562285.674905:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573760 00000100:00100000:3.0:1783562285.674923:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783562285.674929:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563573760:12345-0@lo:503: 00000100:00100000:3.0:1783562285.675170:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563573760:12345-0@lo:503: Request processed in 240us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.675176:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783562285.675207:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563573760:0@lo:503: 00000100:00100000:1.0:1783562285.675962:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6609:1870200563573888:0@lo:502: 00000100:00100000:1.0:1783562285.676001:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.676022:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd2082240 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.676846:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563573888 00000100:00100000:3.0:1783562285.676852:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563573888 00000100:00100000:3.0:1783562285.676887:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783562285.676895:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:6609:x1870200563573888:12345-0@lo:502: 00000100:00100000:3.0:1783562285.677107:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:6609:x1870200563573888:12345-0@lo:502: Request processed in 212us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.677114:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783562285.677304:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6609:1870200563573888:0@lo:502: 00000020:01000000:1.0:1783562285.677334:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562285.677343:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562285.677346:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783562285.677353:0:6609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc78df800 00000020:00000080:1.0:1783562285.677361:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783562285.677387:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6609:1870200563574016:0@lo:502: 00000100:00100000:1.0:1783562285.677446:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.677466:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd2082240 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.677820:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574016 00000100:00100000:3.0:1783562285.677824:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574016 00000100:00100000:3.0:1783562285.677858:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783562285.677866:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:6609:x1870200563574016:12345-0@lo:502: 00000100:00100000:3.0:1783562285.678460:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:6609:x1870200563574016:12345-0@lo:502: Request processed in 593us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.678464:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:6609:1870200563574016:0@lo:502: 00000100:00100000:3.0:1783562285.678468:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:01000000:0.0:1783562285.678499:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562285.678505:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562285.678507:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783562285.678512:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783562285.678639:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783562285.678658:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562285.678670:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.678681:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562285.678692:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783562285.678695:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfcc3f199c0 from 1 10000000:01000000:1.0:1783562285.678698:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783562285.678724:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.678733:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.678743:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562285.678768:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563574144:0@lo:101: 00000100:00100000:1.0:1783562285.678798:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.678823:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd20826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.678869:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574144 00000100:00100000:0.0:1783562285.678874:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574144 00000100:00100000:0.0:1783562285.679002:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783562285.679011:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563574144:12345-0@lo:101: 00010000:00010000:0.0:1783562285.679020:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562285.679033:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87cb1 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.679054:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.679065:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562285.679074:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030e00, rc 0) 00000100:00100000:0.0:1783562285.679122:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563574144:12345-0@lo:101: Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.679128:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783562285.679165:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563574144:0@lo:101: 00010000:00010000:2.0:1783562285.679178:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562285.679187:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562285.679229:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563574272:0@lo:501: 00000100:00100000:2.0:1783562285.679255:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562285.679268:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.679530:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574272 00000100:00100000:3.0:1783562285.679534:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574272 00000100:00100000:3.0:1783562285.679599:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783562285.679607:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563574272:12345-0@lo:501: 00000100:00100000:3.0:1783562285.680164:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563574272:12345-0@lo:501: Request processed in 556us (907us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783562285.680171:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783562285.680197:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563574272:0@lo:501: 10000000:01000000:1.0:1783562285.680220:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783562285.680226:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562285.680241:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562285.692483:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783562285.708236:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563574400:0@lo:13: 00000100:00100000:2.0:1783562285.708332:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783562285.708497:0:6607:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783562285.708523:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574528:0@lo:7: 00000100:00100000:0.0:1783562285.708557:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.708581:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.708603:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574400 00000100:00100000:0.0:1783562285.708609:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574400 00000100:00100000:0.0:1783562285.708657:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562285.708666:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563574400:12345-0@lo:13: 00002000:00000024:0.0:1783562285.708687:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1783562285.708783:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563574400:12345-0@lo:13: Request processed in 118us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.708791:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783562285.708823:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783562285.708867:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcd0f70380 x1870200563574400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562285.708885:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563574400:0@lo:13: 00000100:00100000:0.0:1783562285.709465:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574528 00000100:00100000:0.0:1783562285.709470:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574528 00000100:00100000:0.0:1783562285.709499:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562285.709507:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6607:x1870200563574528:12345-0@lo:7: 00002000:00080000:0.0:1783562285.714644:0:6550:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1783562285.714653:0:6550:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783562285.714744:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6607:x1870200563574528:12345-0@lo:7: Request processed in 5233us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.714767:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783562285.714824:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcd0f70700 x1870200563574528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783562301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562285.714840:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574528:0@lo:7: 00000004:00080000:0.0:1783562285.714857:0:6607:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783562285.714891:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574656:0@lo:5: 00000100:00100000:0.0:1783562285.714935:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.714970:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562285.714988:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574656 00000100:00100000:0.0:1783562285.714994:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574656 00000100:00100000:0.0:1783562285.715044:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562285.715053:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6607:x1870200563574656:12345-0@lo:5: 00002000:00080000:0.0:1783562285.715077:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783562285.715080:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783562285.715258:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:6607:x1870200563574656:12345-0@lo:5: Request processed in 206us (324us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783562285.715262:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783562285.715293:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcd0f70700 x1870200563574656/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562285.715304:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574656:0@lo:5: 00000004:00080000:0.0:1783562285.715312:0:6607:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783562285.715334:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574784:0@lo:700: 00000100:00100000:0.0:1783562285.715351:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562285.715366:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562285.715435:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574784 00000100:00100000:3.0:1783562285.715448:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574784 00000100:00100000:3.0:1783562285.715492:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562285.715500:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6607:x1870200563574784:12345-0@lo:700: 00000100:00100000:3.0:1783562285.715530:0:6556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6556:1870200563574912:0@lo:700: 00000100:00100000:3.0:1783562285.715562:0:6556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562285.715724:0:6556:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562285.715731:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563574912 00000100:00100000:2.0:1783562285.715737:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563574912 00000100:00100000:2.0:1783562285.715792:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562285.715801:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6556:x1870200563574912:12345-0@lo:700: 00000100:00080000:0.0:1783562285.716254:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1783562285.740327:0:5761:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1783562285.746119:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6556:x1870200563574912:12345-0@lo:700: Request processed in 30310us (30547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562285.746138:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783562285.746140:0:6556:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcc7e29500 x1870200563574912/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783562301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562285.746155:0:6556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6556:1870200563574912:0@lo:700: 40000000:02000000:3.0:1783562285.746166:0:6556:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1783562285.786236:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783562285.786263:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1783562285.787516:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcd0f71c00 x1870200563574784/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783562301 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562285.787538:0:6607:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783562285.787560:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563574784:0@lo:700: 00000100:00100000:3.0:1783562285.787768:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6607:x1870200563574784:12345-0@lo:700: Request processed in 72267us (72412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562285.787781:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:02000040:0.0:1783562285.815250:0:6607:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1783562285.817989:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563575040:0@lo:5: 00000100:00100000:0.0:1783562285.818064:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562285.818837:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575040 00000100:00100000:1.0:1783562285.818847:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575040 00000100:00100000:1.0:1783562285.818906:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562285.818916:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6607:x1870200563575040:12345-0@lo:5: 00000100:00100000:0.0:1783562285.819852:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7ba19c0 going to sleep for 11 seconds 00002000:00080000:0.0:1783562285.824288:0:6549:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783562285.824308:0:6549:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783562285.827115:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6607:x1870200563575040:12345-0@lo:5: Request processed in 8193us (9043us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783562285.827128:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783562285.827235:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9bfcd0f71c00 x1870200563575040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562301 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562285.827256:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6607:1870200563575040:0@lo:5: 00000004:00080000:1.0:1783562285.827270:0:6607:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1783562286.007832:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562287.031270:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562288.054597:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783562288.318600:0:6918:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783562289.078854:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562290.103534:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562291.062711:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563575168:0@lo:13: 00000100:00100000:0.0:1783562291.062796:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562291.062901:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575168 00000100:00100000:0.0:1783562291.062910:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575168 00000100:00100000:0.0:1783562291.062988:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562291.062999:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563575168:12345-0@lo:13: 00002000:00000024:0.0:1783562291.063036:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562291.063088:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563575168:12345-0@lo:13: Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562291.063097:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783562291.063125:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562291.063150:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563575424:0@lo:400: 00010000:00080000:0.0:1783562291.063167:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcd0f72680 x1870200563575168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562291.063191:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563575168:0@lo:13: 00000100:00100000:3.0:1783562291.063193:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562291.063194:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563575296:0@lo:400: 00000100:00100000:0.0:1783562291.063226:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783562291.063236:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563575552:0@lo:400: 00000100:00100000:3.0:1783562291.063238:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575424 00000100:00100000:3.0:1783562291.063244:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575424 00000100:00100000:3.0:1783562291.063276:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562291.063299:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563575424:12345-0@lo:400: 00000100:00100000:0.0:1783562291.067188:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562291.067235:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575552 00000100:00100000:1.0:1783562291.067248:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575552 00000100:00080000:0.0:1783562291.067291:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562291.067326:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562291.067338:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563575552:12345-0@lo:400: 00000100:00100000:1.0:1783562291.067430:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563575552:12345-0@lo:400: Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562291.067439:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783562291.067477:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcc7e29180 x1870200563575552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562291.067495:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563575552:0@lo:400: 00000100:00100000:3.0:1783562291.070302:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563575424:12345-0@lo:400: Request processed in 7002us (7095us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562291.070325:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562291.070495:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783562291.072194:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcc7e28e00 x1870200563575424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562291.072215:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563575424:0@lo:400: 00000100:00100000:0.0:1783562291.072673:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575296 00000100:00100000:0.0:1783562291.072684:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575296 00000100:00100000:0.0:1783562291.072748:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783562291.072761:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563575296:12345-0@lo:400: 00000100:00100000:0.0:1783562291.072874:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563575296:12345-0@lo:400: Request processed in 115us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562291.072884:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783562291.072891:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563575296:0@lo:400: 00000001:00080000:2.0:1783562291.103842:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1783562291.126625:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562292.151866:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562293.174579:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562294.199253:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783562294.782155:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783562294.782161:0:7440:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783562294.782323:0:7440:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfceec04800 00000020:01000004:1.0:1783562294.782342:0:7440:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783562294.782358:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783562294.782381:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bfcf712cd40) 00000020:00000080:1.0:1783562294.782449:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783562294.809838:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783562294.810024:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783562294.832261:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783562294.837345:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783562294.837380:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783562294.837475:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783562294.837504:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783562294.837851:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783562294.837862:0:7440:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783562294.837871:0:7440:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b87cc6 00000020:01000004:2.0:1783562294.837879:0:7440:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783562294.837899:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783562294.837902:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783562294.837907:0:7440:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783562294.837929:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783562294.837934:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783562294.864217:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783562294.864276:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1783562294.864282:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783562294.864284:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783562294.864286:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562294.864288:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562294.864289:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562294.864291:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562294.864293:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562294.864295:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783562294.864297:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783562294.864299:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562294.864301:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562294.864307:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1783562294.864311:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783562294.864312:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783562294.864314:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562294.864315:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562294.864317:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562294.864318:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562294.864319:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562294.864321:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783562294.864322:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783562294.864323:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562294.864324:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562294.864370:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783562294.864809:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563575680:0@lo:253: 00000100:00100000:3.0:1783562294.864916:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.865031:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6ec1600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.866364:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575680 00000100:00100000:0.0:1783562294.866381:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575680 00000100:00100000:0.0:1783562294.866486:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783562294.866501:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:7440:x1870200563575680:12345-0@lo:253: 20000000:01000000:0.0:1783562294.866937:0:5748:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783562294.866942:0:5748:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783562294.866948:0:5748:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783562294.866952:0:5748:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783562294.869662:0:5748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562294.870230:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783562294.870248:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783562294.870363:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783562294.870373:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783562294.870663:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783562294.870720:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783562294.871660:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783562294.871685:0:5748:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.104@tcp 20000000:01000000:1.0:1783562294.871688:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.104@tcp (null) (null) (null) 00000040:00080000:1.0:1783562294.871728:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783562294.871737:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783562294.871787:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783562294.871795:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.104@tcp (null) (null) 00000040:00080000:1.0:1783562294.871826:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1783562294.871835:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783562294.872031:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1783562294.872082:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1783562294.873352:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1783562294.873384:0:5748:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.104@tcp 20000000:01000000:1.0:1783562294.873387:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.104@tcp (null) (null) (null) 00000040:00080000:1.0:1783562294.873598:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1783562294.873607:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783562294.873639:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1783562294.873646:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.104@tcp (null) (null) 00000040:00080000:1.0:1783562294.873681:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1783562294.873690:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783562294.873743:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1783562294.873784:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1783562294.873811:0:5748:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1783562294.873815:0:5748:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1783562294.873821:0:5748:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783562294.873823:0:5748:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783562294.873825:0:5748:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783562294.873839:0:5748:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783562294.873842:0:5748:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783562294.874142:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783562294.874146:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783562294.875546:0:7442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1783562294.875622:0:7442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1783562294.875671:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1783562294.876102:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1783562294.876148:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1783562294.876211:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1783562294.876225:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783562294.876228:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783562294.878631:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1783562294.879192:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1783562294.879243:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1783562294.879324:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1783562294.879356:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783562294.879358:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783562294.880300:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783562294.880351:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783562294.880445:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783562294.880747:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1783562294.880777:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1783562294.880795:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1783562294.880808:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783562294.880809:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783562294.881626:0:7445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1783562294.881696:0:7445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1783562294.881731:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1783562294.882002:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1783562294.882235:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1783562294.882284:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1783562294.882303:0:5748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783562294.882321:0:5748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882341:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882350:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882357:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882364:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882371:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882377:0:5748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882520:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882551:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 16 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.882567:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563575808:0@lo:104: 00000100:00100000:3.0:1783562294.882654:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562294.882710:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882717:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 16 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.882725:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563575936:0@lo:104: 00000100:00100000:3.0:1783562294.882748:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562294.882773:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882782:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 16 pid: 5748 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.882792:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576064:0@lo:104: 00000100:00100000:0.0:1783562294.882820:0:5738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783562294.882821:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882838:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 16 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.882846:0:5738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.882853:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576192:0@lo:104: 00000100:00100000:0.0:1783562294.882888:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575808 00000100:00100000:0.0:1783562294.882895:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575808 00000100:00100000:0.0:1783562294.882925:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563575936 00000100:00100000:0.0:1783562294.882928:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563575936 00000100:00100000:0.0:1783562294.882937:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576064 00000100:00100000:0.0:1783562294.882940:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576064 00000100:00100000:0.0:1783562294.882958:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783562294.882963:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.882969:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5748:x1870200563575808:12345-0@lo:104: 00010000:00010000:0.0:1783562294.882985:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.882995:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883006:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 16 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.883014:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576320:0@lo:104: 00000100:00100000:3.0:1783562294.883037:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.883051:0:5748:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6ec16c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783562294.883071:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783562294.883074:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563575808:0@lo:104: 00000100:00100000:0.0:1783562294.883082:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5748:x1870200563575808:12345-0@lo:104: Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.883091:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562294.883107:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576192 00000100:00100000:0.0:1783562294.883110:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576192 00000100:00100000:0.0:1783562294.883120:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576320 00000100:00100000:0.0:1783562294.883122:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576320 00000100:00100000:0.0:1783562294.883133:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783562294.883151:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd066d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5748:x1870200563575936:12345-0@lo:104: 00010000:00010000:0.0:1783562294.883160:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.883200:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562294.883208:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562294.883215:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd066d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:5748:x1870200563575936:12345-0@lo:104: Request processed in 77us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.883220:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562294.883250:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563575936:0@lo:104: 00000100:00100000:0.0:1783562294.883264:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783562294.883272:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5748:x1870200563576064:12345-0@lo:104: 00010000:00010000:0.0:1783562294.883296:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.883301:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.883312:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562294.883317:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.883328:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883336:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783562294.883344:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:5748:x1870200563576064:12345-0@lo:104: Request processed in 73us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.883358:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:00010000:2.0:1783562294.883363:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562294.883371:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783562294.883374:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562294.883382:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:5748:x1870200563576192:12345-0@lo:104: 00010000:00010000:0.0:1783562294.883389:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883441:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783562294.883457:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:5748:x1870200563576192:12345-0@lo:104: Request processed in 76us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.883464:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562294.883479:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783562294.883485:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5748:x1870200563576320:12345-0@lo:104: 00010000:00010000:0.0:1783562294.883492:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883506:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883514:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562294.883534:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883534:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783562294.883544:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5748:x1870200563576320:12345-0@lo:104: Request processed in 58us (505us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562294.883547:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b87cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87cb8 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.883555:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1783562294.883569:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783562294.883585:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883589:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562294.883593:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562294.883598:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883606:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.883615:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576448:0@lo:103: 10000000:00010000:3.0:1783562294.883621:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562294.883633:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562294.883654:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883661:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783562294.883667:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562294.883681:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883692:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b87c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c80 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883709:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562294.883713:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.883716:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576448 00000100:00100000:0.0:1783562294.883722:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576448 00010000:00010000:3.0:1783562294.883723:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562294.883729:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883736:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883742:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562294.883747:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562294.883759:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783562294.883775:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562294.883783:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3273:x1870200563576448:12345-0@lo:103: 00010000:00010000:0.0:1783562294.883794:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562294.883795:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883801:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883808:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562294.883822:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883822:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883842:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c3a expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.883850:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0030e00/0x4738ba0933b87cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87cb1 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883857:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562294.883867:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562294.883876:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883885:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562294.883888:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883895:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.883902:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3273:x1870200563576448:12345-0@lo:103: Request processed in 118us (234us total) trans 0 rc 0/0 10000000:00010000:3.0:1783562294.883906:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.883915:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:01000000:3.0:1783562294.883918:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562294.883936:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883943:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562294.883956:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883975:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031800/0x4738ba0933b87c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c10 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.883987:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562294.883990:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562294.883992:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562294.884007:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563576576:0@lo:103: 00000100:00100000:3.0:1783562294.884037:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.884064:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562294.884071:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563576704:0@lo:103: 00010000:00010000:0.0:1783562294.884098:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562294.884099:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562294.884107:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.884116:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562294.884119:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.884138:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.884140:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576576 00000100:00100000:3.0:1783562294.884147:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576576 10000000:00010000:0.0:1783562294.884148:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.884153:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576448:0@lo:103: 10000000:01000000:0.0:1783562294.884158:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783562294.884170:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 16 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.884174:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783562294.884178:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.884185:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576832:0@lo:103: 00010000:00010000:0.0:1783562294.884190:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783562294.884200:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576704 00010000:00010000:0.0:1783562294.884202:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.884205:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576704 00010000:00010000:0.0:1783562294.884214:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfd020c8800/0x4738ba0933b87c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c64 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.884223:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 17 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.884227:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562294.884239:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562294.884243:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562294.884246:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576832 00010000:00010000:0.0:1783562294.884247:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562294.884252:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576832 00000100:00100000:1.0:1783562294.884252:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576960:0@lo:103: 00010000:00010000:0.0:1783562294.884256:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562294.884261:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562294.884271:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 18 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.884286:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.884292:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783562294.884302:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576064:0@lo:104: 00000100:00100000:3.0:1783562294.884304:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3274:x1870200563576576:12345-0@lo:103: 00000100:00100000:0.0:1783562294.884320:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576192:0@lo:104: 00010000:00010000:3.0:1783562294.884326:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783562294.884329:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1870200563576320:0@lo:104: 00010000:00010000:3.0:1783562294.884336:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 18 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.884348:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 18 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562294.884432:0:5741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783562294.884440:0:5741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783562294.884461:0:5740:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783562294.884469:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563576960 00000100:00100000:2.0:1783562294.884472:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563576960 00010000:00010000:2.0:1783562294.884486:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 19 pid: 5748 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562294.884498:0:5740:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783562294.884505:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562294.884510:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563576704:12345-0@lo:103: 00010000:00010000:2.0:1783562294.884518:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562294.884522:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 19 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886427:0:5748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.886497:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b87c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c79 expref: 19 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.886523:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562294.886622:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3274:x1870200563576576:12345-0@lo:103: Request processed in 2321us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.886632:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562294.886661:0:5739:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783562294.886673:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562294.886682:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3273:x1870200563576832:12345-0@lo:103: 00010000:00010000:3.0:1783562294.886698:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562294.886705:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.886715:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.886729:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c09 expref: 17 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.886741:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563576576:0@lo:103: 00010000:00010000:3.0:1783562294.886744:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562294.886779:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 16 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.886787:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3273:x1870200563576832:12345-0@lo:103: Request processed in 108us (2565us total) trans 0 rc 0/0 00010000:00010000:2.0:1783562294.886794:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfd020c8600/0x4738ba0933b87c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c33 expref: 16 pid: 5750 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.886804:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576832:0@lo:103: 00010000:00010000:2.0:1783562294.886805:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562294.886812:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562294.886835:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562294.886836:0:5739:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783562294.886846:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:3274:x1870200563576704:12345-0@lo:103: Request processed in 2334us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.886856:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783562294.886860:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:3273:x1870200563576960:12345-0@lo:103: 00010000:00010000:0.0:1783562294.886875:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562294.886882:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 13 pid: 5748 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886894:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 13 pid: 5748 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562294.886904:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563576704:0@lo:103: 00010000:00010000:0.0:1783562294.886908:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b87c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c5d expref: 13 pid: 5748 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886928:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886938:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886954:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886962:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886971:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886978:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.886985:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562294.886990:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.887006:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.887032:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.887043:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562294.887083:0:5748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.887085:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:3273:x1870200563576960:12345-0@lo:103: Request processed in 231us (2800us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562294.887101:0:5748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562294.887103:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562294.887111:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563576960:0@lo:103: 00010000:00010000:1.0:1783562294.887114:0:5748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b87ccd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562294.887132:0:5748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783562294.925833:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:7440:x1870200563575680:12345-0@lo:253: Request processed in 59326us (60906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562294.925849:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783562294.925939:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563575680:0@lo:253: 10000000:01000000:3.0:1783562294.925954:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783562294.925958:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783562294.925959:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783562294.925961:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562294.925962:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1783562294.925963:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562294.925965:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562294.925966:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562294.925967:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783562294.925969:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562294.925970:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783562294.925989:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfceec04800 from lustre-OST0001 10000000:01000000:3.0:1783562294.926014:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783562294.926018:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783562294.926026:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfcc3f199c0 local copy 10000000:01000000:3.0:1783562294.926030:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783562294.926065:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.926077:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.926086:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.926179:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577088:0@lo:101: 00000100:00100000:3.0:1783562294.926221:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.926313:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.926356:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577088 00000100:00100000:0.0:1783562294.926363:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577088 00000100:00100000:2.0:1783562294.926612:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783562294.926624:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+11:7440:x1870200563577088:12345-0@lo:101: 00010000:00010000:2.0:1783562294.926639:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562294.926654:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87cd4 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.926674:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87cd4 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.926681:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87cd4 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.926689:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:2.0:1783562294.926721:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577088:12345-0@lo:101: Request processed in 102us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.926725:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783562294.926962:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577088:0@lo:101: 00010000:00010000:3.0:1783562294.926991:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.927000:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.927204:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577216:0@lo:501: 00000100:00100000:3.0:1783562294.927233:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.927304:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:1.0:1783562294.927345:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577216 00000100:00100000:1.0:1783562294.927351:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577216 00000100:00100000:1.0:1783562294.927390:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783562294.927398:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577216:12345-0@lo:501: 00000100:00100000:1.0:1783562294.927702:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577216:12345-0@lo:501: Request processed in 304us (466us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562294.927710:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783562294.927821:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577216:0@lo:501: 10000000:01000000:3.0:1783562294.927835:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783562294.927863:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783562294.927869:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.927879:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.927887:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.927955:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783562294.927980:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfceec04800 10000000:01000000:3.0:1783562294.927985:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783562294.927990:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783562294.927992:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562294.927996:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783562294.927999:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783562294.928026:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.928034:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.928042:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.928055:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577344:0@lo:101: 00000100:00100000:3.0:1783562294.928084:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.928125:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562294.928243:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577344 00000100:00100000:1.0:1783562294.928248:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577344 00000100:00100000:1.0:1783562294.928283:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783562294.928293:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577344:12345-0@lo:101: 00010000:00010000:1.0:1783562294.928301:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562294.928312:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87ce2 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.928330:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.928347:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.928356:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499a00, rc 0) 00000100:00100000:1.0:1783562294.928392:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563577344:12345-0@lo:101: Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562294.928398:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783562294.928488:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577344:0@lo:101: 00010000:00010000:3.0:1783562294.928499:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.928507:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562294.928568:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577472:0@lo:501: 00000100:00100000:3.0:1783562294.928606:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.928633:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.928687:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577472 00000100:00100000:2.0:1783562294.928692:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577472 00000100:00100000:2.0:1783562294.928721:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783562294.928729:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563577472:12345-0@lo:501: 00010000:00010000:0.0:1783562294.928779:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562294.928788:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.928798:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562294.928803:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.928813:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562294.928823:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562294.928830:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783562294.928854:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.928872:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562294.928895:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.928904:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b87cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4738ba0933b87cdb expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.928920:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562294.928924:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562294.928927:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562294.928930:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563577472:12345-0@lo:501: Request processed in 200us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.928938:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783562294.928951:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562294.928966:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563577600:0@lo:103: 00000100:00100000:2.0:1783562294.928973:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577472:0@lo:501: 00000100:00100000:2.0:1783562294.929005:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577728:0@lo:503: 00000100:00100000:0.0:1783562294.929019:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562294.929051:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.929062:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577600 00000100:00100000:0.0:1783562294.929068:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577600 00000100:00100000:2.0:1783562294.929071:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.929087:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577728 00000100:00100000:0.0:1783562294.929106:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562294.929114:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:3275:x1870200563577600:12345-0@lo:103: 00010000:00010000:0.0:1783562294.929124:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562294.929153:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b87cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87cd4 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.929173:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562294.929204:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:3275:x1870200563577600:12345-0@lo:103: Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.929217:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562294.929224:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563577600:0@lo:103: 00000100:00100000:2.0:1783562294.929360:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577728 00000100:00100000:2.0:1783562294.929493:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783562294.929501:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577728:12345-0@lo:503: 00000100:00100000:2.0:1783562294.929679:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577728:12345-0@lo:503: Request processed in 177us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.929685:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783562294.929717:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577728:0@lo:503: 00000040:00080000:0.0:1783562294.930045:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783562294.930349:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577856:0@lo:502: 00000100:00100000:0.0:1783562294.930393:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.930460:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562294.930509:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577856 00000100:00100000:3.0:1783562294.930516:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577856 00000100:00100000:3.0:1783562294.930659:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783562294.930669:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577856:12345-0@lo:502: 00000100:00100000:3.0:1783562294.930848:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577856:12345-0@lo:502: Request processed in 180us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.930863:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783562294.930881:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577856:0@lo:502: 00000040:00080000:0.0:1783562294.931290:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783562294.931345:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783562294.931381:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783562294.931461:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783562294.931504:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783562294.931537:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783562294.931567:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577984:0@lo:502: 00000100:00100000:0.0:1783562294.931625:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.931670:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.931787:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563577984 00000100:00100000:2.0:1783562294.931794:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563577984 00000100:00100000:2.0:1783562294.931877:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783562294.931886:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577984:12345-0@lo:502: 00000100:00100000:2.0:1783562294.932059:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563577984:12345-0@lo:502: Request processed in 175us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.932066:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783562294.932144:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563577984:0@lo:502: 00000040:00080000:0.0:1783562294.932253:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783562294.932264:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783562294.933629:0:7451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783562294.933639:0:7451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783562294.933646:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562294.933648:0:7451:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783562294.933655:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783562294.933678:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bfcf6b919c0) 00000020:00000080:3.0:1783562294.933698:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783562294.933703:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783562294.933758:0:7451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfceec04800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783562294.933764:0:7451:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783562294.933771:0:7451:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b87cf7 00010000:00010000:3.0:1783562294.936657:0:7451:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1783562294.937019:0:7451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1783562294.941172:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783562294.941590:0:7451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1783562294.946184:0:7451:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1783562294.946737:0:7451:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783562294.948016:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783562294.948029:0:7451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562294.948035:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562294.948038:0:7451:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783562294.948042:0:7451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562294.948046:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562294.948047:0:7451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783562294.948050:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783562294.948052:0:7451:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783562294.948103:0:7451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562294.948106:0:7451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562294.948107:0:7451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783562294.948110:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783562294.948308:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783562294.948338:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783562294.948371:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.948386:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562294.948429:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfceec04800 from 1 10000000:01000000:2.0:1783562294.948432:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562294.948476:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.948495:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.948508:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562294.948537:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578112:0@lo:101: 00000100:00100000:2.0:1783562294.948625:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562294.948681:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562294.949447:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578112 00000100:00100000:3.0:1783562294.949458:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578112 00000100:00100000:3.0:1783562294.949506:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783562294.949516:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:7440:x1870200563578112:12345-0@lo:101: 00010000:00010000:3.0:1783562294.949530:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562294.949545:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87cfe expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.949583:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.949596:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562294.949605:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336000, rc 0) 00000100:00100000:3.0:1783562294.949665:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578112:12345-0@lo:101: Request processed in 151us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.949672:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783562294.949751:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578112:0@lo:101: 00010000:00010000:2.0:1783562294.949769:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.949780:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562294.949894:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578240:0@lo:501: 00000100:00100000:2.0:1783562294.949927:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562294.949963:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562294.949969:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578240 00000100:00100000:3.0:1783562294.949974:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578240 00000100:00100000:3.0:1783562294.950007:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783562294.950014:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578240:12345-0@lo:501: 00000100:00100000:2.0:1783562294.950841:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578240:0@lo:501: 00000100:00100000:2.0:1783562294.950883:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578368:0@lo:503: 00000100:00100000:3.0:1783562294.952708:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578240:12345-0@lo:501: Request processed in 2682us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.952728:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783562294.953486:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.953740:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578368 00000100:00100000:0.0:1783562294.953751:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578368 00000100:00100000:0.0:1783562294.953799:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783562294.953810:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578368:12345-0@lo:503: 00000100:00100000:3.0:1783562294.954231:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.954304:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578368:12345-0@lo:503: Request processed in 496us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.954314:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783562294.954456:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578368:0@lo:503: 00000040:00080000:3.0:1783562294.954823:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783562294.954905:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578496:0@lo:502: 00000100:00100000:3.0:1783562294.954958:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.954989:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.955877:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578496 00000100:00100000:2.0:1783562294.955887:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578496 00000100:00100000:2.0:1783562294.955948:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783562294.955960:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578496:12345-0@lo:502: 00000100:00100000:2.0:1783562294.956247:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578496:12345-0@lo:502: Request processed in 288us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.956256:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783562294.956287:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578496:0@lo:502: 00000040:00080000:3.0:1783562294.956633:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783562294.956678:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783562294.956704:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578624:0@lo:502: 00000100:00100000:3.0:1783562294.956738:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.956767:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd35cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.956774:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578624 00000100:00100000:0.0:1783562294.956779:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578624 00000100:00100000:0.0:1783562294.956809:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783562294.956817:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578624:12345-0@lo:502: 00000100:00100000:0.0:1783562294.957083:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578624:12345-0@lo:502: Request processed in 266us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.957096:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783562294.957147:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578624:0@lo:502: 00000040:00080000:1.0:1783562294.957218:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783562294.957229:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783562294.958042:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562294.958055:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562294.958057:0:7455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783562294.958066:0:7455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfceec04800 00000020:00000080:2.0:1783562294.958069:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562294.958089:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562294.958093:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562294.958094:0:7455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783562294.958097:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783562294.958258:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783562294.958286:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562294.958312:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.958329:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562294.958380:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783562294.958384:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfceec04800 10000000:01000000:1.0:1783562294.958387:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfceec04800 10000000:01000000:1.0:1783562294.958392:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783562294.958397:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfceec04800 from 1 10000000:01000000:1.0:1783562294.958538:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562294.958584:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.958592:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.958611:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.958632:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578752:0@lo:101: 00000100:00100000:1.0:1783562294.958691:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.958766:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7804d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.958815:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578752 00000100:00100000:2.0:1783562294.958822:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578752 00000100:00100000:2.0:1783562294.958936:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783562294.958946:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563578752:12345-0@lo:101: 00010000:00010000:2.0:1783562294.958962:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562294.958976:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d0c expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.959000:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 14 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.959012:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 14 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562294.959021:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2200, rc 0) 00000100:00100000:2.0:1783562294.959111:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563578752:12345-0@lo:101: Request processed in 167us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.959118:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783562294.959185:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578752:0@lo:101: 00010000:00010000:1.0:1783562294.959198:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562294.959206:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562294.959290:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578880:0@lo:501: 00000100:00100000:1.0:1783562294.959317:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.959374:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7804d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.959583:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563578880 00000100:00100000:0.0:1783562294.959588:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563578880 00000100:00100000:0.0:1783562294.959617:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783562294.959623:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563578880:12345-0@lo:501: 00000100:00100000:0.0:1783562294.959937:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563578880:12345-0@lo:501: Request processed in 313us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.959944:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783562294.959997:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563578880:0@lo:501: 00000100:00100000:1.0:1783562294.960027:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579008:0@lo:503: 00000100:00100000:1.0:1783562294.960065:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.960126:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7804d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.960165:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579008 00000100:00100000:2.0:1783562294.960169:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579008 00000100:00100000:2.0:1783562294.960202:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783562294.960210:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579008:12345-0@lo:503: 00000100:00100000:2.0:1783562294.960434:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579008:12345-0@lo:503: Request processed in 224us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.960441:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783562294.960553:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579008:0@lo:503: 00000040:00080000:1.0:1783562294.960943:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783562294.961004:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579136:0@lo:502: 00000100:00100000:1.0:1783562294.961043:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.961105:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdac839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562294.961152:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579136 00000100:00100000:0.0:1783562294.961156:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579136 00000100:00100000:0.0:1783562294.961189:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783562294.961196:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579136:12345-0@lo:502: 00000100:00100000:0.0:1783562294.961439:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579136:12345-0@lo:502: Request processed in 242us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.961446:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783562294.961537:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579136:0@lo:502: 00000040:00080000:1.0:1783562294.961784:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783562294.961833:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783562294.961931:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783562294.961984:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783562294.962006:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783562294.962031:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783562294.962049:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783562294.962065:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783562294.962089:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783562294.962106:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783562294.962123:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783562294.962158:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783562294.962191:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783562294.962219:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783562294.962260:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783562294.962292:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783562294.962323:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783562294.962365:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783562294.962613:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783562294.962659:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783562294.962733:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783562294.962778:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783562294.962814:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783562294.962955:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783562294.962990:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783562294.963021:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783562294.963066:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783562294.963101:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1783562294.963133:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783562294.963176:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1783562294.963210:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1783562294.963256:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1783562294.963288:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1783562294.963333:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1783562294.963367:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1783562294.963602:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1783562294.963641:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1783562294.963705:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579264:0@lo:502: 00000100:00100000:1.0:1783562294.963787:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.963891:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdac839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562294.964023:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579264 00000100:00100000:2.0:1783562294.964031:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579264 00000100:00100000:2.0:1783562294.964131:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783562294.964142:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579264:12345-0@lo:502: 00000100:00100000:2.0:1783562294.964441:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563579264:12345-0@lo:502: Request processed in 261us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562294.964449:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783562294.964615:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563579264:0@lo:502: 00000040:00080000:1.0:1783562294.964707:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1783562294.964719:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783562294.965343:0:7456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783562294.965376:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bfcef6499c0) 00000020:00000080:1.0:1783562294.965398:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1783562294.965599:0:7456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfceec04800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562294.965604:0:7456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfceec04800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562294.965607:0:7456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfceec04800 3 00010000:00080000:1.0:1783562294.965648:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcef657800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562294.970052:0:7456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1783562294.970168:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783562294.970221:0:7456:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783562294.970242:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4738ba0933b87d21 00000100:00080000:1.0:1783562294.970258:0:7456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562294.970267:0:7456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bfcef657800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562294.970324:0:7456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcf7123800 x1870200563579392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562294.970528:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563579392:0@lo:38: 00000100:00100000:0.0:1783562294.970654:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783562294.970729:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783562294.970983:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563579648:0@lo:400: 00000100:00100000:0.0:1783562294.971017:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562294.971059:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563579520:0@lo:400: 00000100:00100000:0.0:1783562294.971248:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562294.971255:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563579776:0@lo:400: 00000100:00100000:0.0:1783562294.971283:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.971317:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579776 00000100:00100000:0.0:1783562294.971325:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579776 00000100:00100000:0.0:1783562294.971424:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562294.971436:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563579776:12345-0@lo:400: 00000100:00100000:0.0:1783562294.971508:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563579776:12345-0@lo:400: Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.971516:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783562294.971540:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562294.971555:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.971636:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579392 00000100:00100000:3.0:1783562294.971641:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579392 00000100:00100000:3.0:1783562294.971669:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579648 00000100:00100000:3.0:1783562294.971672:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579648 00000100:00100000:3.0:1783562294.971704:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562294.971713:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563579648:12345-0@lo:400: 00000100:00100000:3.0:1783562294.971751:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563579648:12345-0@lo:400: Request processed in 41us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.971757:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562294.971770:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562294.971774:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3271:x1870200563579392:12345-0@lo:38: 00010000:00080000:3.0:1783562294.971813:0:5755:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 104 last 0 00000020:00000080:3.0:1783562294.971850:0:5755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4738ba0933b87d28 00000004:00100000:3.0:1783562294.971947:0:5755:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783562294.971987:0:5755:0:(import.c:65:import_set_state_nolock()) ffff9bfcf684a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562294.972032:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1870200563579392:12345-0@lo:38: Request processed in 255us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562294.972039:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783562294.972080:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcf7123800 x1870200563579392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562294.972092:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783562294.972100:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783562294.972108:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783562294.972114:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783562294.972116:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef657800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783562294.972123:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563579392:0@lo:38: 00000100:00100000:0.0:1783562294.972134:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579520 00000100:00100000:0.0:1783562294.972140:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579520 00000100:00100000:0.0:1783562294.972166:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562294.972174:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563579520:12345-0@lo:400: 00000100:00100000:0.0:1783562294.972209:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563579520:12345-0@lo:400: Request processed in 37us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562294.972216:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783562294.972232:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783562294.972251:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcd0f70a80 x1870200563579776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562294.972260:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783562294.972273:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563579776:0@lo:400: 00010000:00080000:0.0:1783562294.972286:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcd0f72d80 x1870200563579648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562294.972294:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563579648:0@lo:400: 00010000:00080000:0.0:1783562294.972496:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcd0f73480 x1870200563579520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562294.972506:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563579520:0@lo:400: 00000040:00080000:1.0:1783562294.973168:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1783562294.973383:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7458:1870200563579904:0@lo:901: 00000100:00100000:3.0:1783562294.973471:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562294.973495:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783562294.973559:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563579904 00000100:00100000:1.0:1783562294.973566:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563579904 00000100:00100000:1.0:1783562294.973628:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562294.973637:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7458:x1870200563579904:12345-0@lo:901: 00000100:00100000:1.0:1783562294.974230:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7458:x1870200563579904:12345-0@lo:901: Request processed in 590us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562294.974239:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783562294.974341:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1783562294.974361:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1783562294.975034:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783562294.975067:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562294.975081:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783562294.975134:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783562294.975137:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783562294.975139:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562294.975140:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562294.975141:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562294.975142:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562294.975144:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562294.975146:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562294.975148:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562294.975150:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562294.975152:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783562294.975157:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1783562294.975160:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783562294.975161:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783562294.975163:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562294.975164:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562294.975165:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562294.975166:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562294.975167:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562294.975167:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562294.975169:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562294.975170:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562294.975170:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783562294.975202:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783562294.975223:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563580032:0@lo:253: 00000100:00100000:0.0:1783562294.975302:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562294.975388:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7ba1600 going to sleep for 11 seconds 00010000:00080000:3.0:1783562294.975509:0:7458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef69aa00 x1870200563579904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783562310 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562294.975525:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7458:1870200563579904:0@lo:901: 00000100:00100000:1.0:1783562294.975682:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580032 00000100:00100000:1.0:1783562294.975691:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580032 00000100:00100000:1.0:1783562294.975780:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783562294.975796:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7440:x1870200563580032:12345-0@lo:253: 20000000:01000000:1.0:1783562294.975841:0:5749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783562294.975858:0:5749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783562295.002801:0:5749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783562295.002819:0:5749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783562295.002842:0:5770:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783562295.002849:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783562295.002872:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.002889:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.002896:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.002937:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.002953:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 14 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562295.002983:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5770:1870200563580160:0@lo:104: 00000100:00100000:3.0:1783562295.003057:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562295.003137:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562295.003160:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580160 00000100:00100000:0.0:1783562295.003169:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580160 00000100:00100000:0.0:1783562295.003217:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783562295.003241:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5770:x1870200563580160:12345-0@lo:104: 00010000:00010000:0.0:1783562295.003257:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562295.003321:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562295.003329:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:5770:x1870200563580160:12345-0@lo:104: Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562295.003336:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783562295.003361:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562295.003368:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562295.003377:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031c00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562295.003381:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562295.003392:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562295.003420:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562295.003427:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783562295.003460:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562295.003468:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562295.003488:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562295.003500:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5770:1870200563580160:0@lo:104: 00000100:00100000:1.0:1783562295.003502:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563580288:0@lo:103: 00010000:00010000:0.0:1783562295.003512:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031c00/0x4738ba0933b87c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c72 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.003533:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562295.003536:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562295.003539:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562295.003541:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562295.003543:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562295.003604:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580288 00000100:00100000:1.0:1783562295.003609:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580288 00010000:00010000:1.0:1783562295.003629:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 15 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562295.003660:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783562295.003667:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:3274:x1870200563580288:12345-0@lo:103: 00010000:00010000:1.0:1783562295.003680:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562295.003686:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 15 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003708:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 15 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003724:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfd020c9e00/0x4738ba0933b87c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c6b expref: 15 pid: 5749 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003740:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003748:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562295.003762:0:7447:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001031358s 00010000:00010000:1.0:1783562295.003766:0:7447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003774:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003783:0:7447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003789:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003794:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562295.003799:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003805:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003833:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562295.003844:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562295.003881:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:3274:x1870200563580288:12345-0@lo:103: Request processed in 214us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562295.003887:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783562295.003945:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563580288:0@lo:103: 00010000:00010000:3.0:1783562295.003961:0:5770:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.003969:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562295.003976:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562295.012620:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:7440:x1870200563580032:12345-0@lo:253: Request processed in 36815us (37305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562295.012638:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783562295.012937:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7440:1870200563580032:0@lo:253: 10000000:01000000:0.0:1783562295.012954:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783562295.012958:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783562295.012960:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783562295.012961:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562295.012963:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562295.012964:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562295.012965:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562295.012967:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562295.012969:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783562295.012970:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783562295.012972:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562295.012974:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783562295.012991:0:7440:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783562295.017629:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562295.017843:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562295.018059:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562295.018226:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562295.018556:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562295.018808:0:7440:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783562295.020021:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783562295.157716:0:7440:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783562295.157729:0:7440:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783562295.157774:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783562295.157841:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783562295.157856:0:7440:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783562295.157886:0:7440:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783562295.225681:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562296.182505:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783562296.182531:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563580416:0@lo:13: 00000100:00100000:0.0:1783562296.182614:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562296.182685:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580416 00000100:00100000:0.0:1783562296.182693:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580416 00000100:00100000:0.0:1783562296.182749:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562296.182759:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563580416:12345-0@lo:13: 00002000:00000024:0.0:1783562296.182796:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562296.182852:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563580416:12345-0@lo:13: Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562296.182866:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783562296.182893:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783562296.182934:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcd0f73480 x1870200563580416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562296.182954:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563580416:0@lo:13: 00010000:00010000:0.0:1783562296.248165:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562297.270631:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562298.294894:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562299.319165:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562299.692544:0:7799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783562300.280679:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563580544:0@lo:400: 00000100:00100000:0.0:1783562300.280757:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.280939:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563580672:0@lo:400: 00000100:00100000:2.0:1783562300.280972:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.281027:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783562300.281034:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563581056:0@lo:400: 00000100:00100000:2.0:1783562300.281074:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.281103:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563580800:0@lo:400: 00000100:00100000:2.0:1783562300.281131:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.281156:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562300.281162:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563580928:0@lo:400: 00000100:00100000:2.0:1783562300.281184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.281225:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580672 00000100:00100000:2.0:1783562300.281232:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580672 00000100:00100000:2.0:1783562300.281275:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581056 00000100:00100000:2.0:1783562300.281278:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581056 00000100:00100000:2.0:1783562300.281300:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580800 00000100:00100000:2.0:1783562300.281302:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580800 00000100:00100000:2.0:1783562300.281319:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562300.281327:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563580672:12345-0@lo:400: 00000100:00100000:2.0:1783562300.281377:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563580672:12345-0@lo:400: Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.281385:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562300.281420:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562300.281429:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563581056:12345-0@lo:400: 00000100:00100000:2.0:1783562300.281456:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563581056:12345-0@lo:400: Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.281463:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562300.281485:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562300.281491:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563580800:12345-0@lo:400: 00000100:00100000:1.0:1783562300.281672:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580544 00000100:00100000:1.0:1783562300.281678:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580544 00000100:00100000:1.0:1783562300.281710:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783562300.281717:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:3272:x1870200563580544:12345-0@lo:400: 00000100:00100000:0.0:1783562300.281938:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563580928 00000100:00100000:0.0:1783562300.281943:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563580928 00000100:00100000:0.0:1783562300.281973:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562300.281980:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563580928:12345-0@lo:400: 00000100:00100000:0.0:1783562300.282015:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563580928:12345-0@lo:400: Request processed in 36us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562300.282021:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783562300.282056:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783562300.282061:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783562300.282092:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70db800 x1870200563581056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562300.282106:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563581056:0@lo:400: 00010000:00080000:0.0:1783562300.282118:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70d9c00 x1870200563580672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562300.282135:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563580672:0@lo:400: 00010000:00080000:0.0:1783562300.282179:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70da680 x1870200563580928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562300.282188:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563580928:0@lo:400: 00000100:00100000:2.0:1783562300.282467:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563580800:12345-0@lo:400: Request processed in 975us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.282483:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783562300.282651:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70dbb80 x1870200563580800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562300.282662:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563580800:0@lo:400: 00000100:00100000:1.0:1783562300.282760:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:3272:x1870200563580544:12345-0@lo:400: Request processed in 1041us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562300.282775:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783562300.282895:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563580544:0@lo:400: 00010000:00010000:0.0:1783562300.344575:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783562300.792634:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783562300.792643:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc7fb7800 from 30 10000000:01000000:1.0:1783562300.792648:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562300.792698:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.792710:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.792721:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.792745:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581184:0@lo:101: 00000100:00100000:1.0:1783562300.792820:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.792878:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd2082a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.793058:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581184 00000100:00100000:3.0:1783562300.793067:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581184 00000100:00100000:3.0:1783562300.793117:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783562300.793127:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563581184:12345-0@lo:101: 00010000:00010000:3.0:1783562300.793142:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562300.793155:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d36 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.793178:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.793189:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.793198:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337600, rc 0) 00000100:00100000:3.0:1783562300.793241:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581184:12345-0@lo:101: Request processed in 111us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.793248:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783562300.793340:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581184:0@lo:101: 00010000:00010000:1.0:1783562300.793354:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.793362:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.793433:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581312:0@lo:501: 00000100:00100000:1.0:1783562300.793457:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.793485:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd2082a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.793569:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581312 00000100:00100000:3.0:1783562300.793582:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581312 00000100:00100000:3.0:1783562300.793603:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783562300.793610:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581312:12345-0@lo:501: 00000100:00100000:3.0:1783562300.794118:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581312:12345-0@lo:501: Request processed in 506us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.794126:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783562300.794733:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581312:0@lo:501: 00000100:00100000:0.0:1783562300.794969:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581440:0@lo:503: 00000100:00100000:0.0:1783562300.795016:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.795048:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.795170:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581440 00000100:00100000:2.0:1783562300.795176:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581440 00000100:00100000:2.0:1783562300.795205:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783562300.795213:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581440:12345-0@lo:503: 00000100:00100000:2.0:1783562300.795724:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581440:12345-0@lo:503: Request processed in 508us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.795731:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783562300.795787:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581440:0@lo:503: 00000100:00100000:0.0:1783562300.796572:0:7872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7872:1870200563581568:0@lo:502: 00000100:00100000:0.0:1783562300.796626:0:7872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.796664:0:7872:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.796712:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581568 00000100:00100000:3.0:1783562300.796718:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581568 00000100:00100000:3.0:1783562300.796761:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783562300.796770:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7872:x1870200563581568:12345-0@lo:502: 00000100:00100000:3.0:1783562300.797080:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7872:x1870200563581568:12345-0@lo:502: Request processed in 309us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.797087:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783562300.797266:0:7872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7872:1870200563581568:0@lo:502: 00000100:00100000:0.0:1783562300.797303:0:7872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7872:1870200563581696:0@lo:502: 00000100:00100000:0.0:1783562300.797330:0:7872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.797483:0:7872:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.797517:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581696 00000100:00100000:2.0:1783562300.797522:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581696 00000100:00100000:2.0:1783562300.797585:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783562300.797593:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7872:x1870200563581696:12345-0@lo:502: 00000100:00100000:2.0:1783562300.797740:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:7872:x1870200563581696:12345-0@lo:502: Request processed in 147us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.797747:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783562300.797809:0:7872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7872:1870200563581696:0@lo:502: 00000040:00080000:0.0:1783562300.797831:0:7872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1783562300.797962:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1783562300.797994:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783562300.798007:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.798020:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562300.798033:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783562300.798037:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1783562300.798041:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562300.798073:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.798082:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.798113:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562300.798127:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581824:0@lo:101: 00000100:00100000:3.0:1783562300.798154:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.798176:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3300 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.798730:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581824 00000100:00100000:1.0:1783562300.798742:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581824 00000100:00100000:1.0:1783562300.798786:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783562300.798798:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563581824:12345-0@lo:101: 00010000:00010000:1.0:1783562300.798810:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562300.798825:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d44 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.798855:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 15 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.798872:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 15 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.798882:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499c00, rc 0) 00000100:00100000:1.0:1783562300.798924:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563581824:12345-0@lo:101: Request processed in 130us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562300.798931:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783562300.798968:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581824:0@lo:101: 00010000:00010000:1.0:1783562300.798982:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.798990:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.799042:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581952:0@lo:501: 00000100:00100000:1.0:1783562300.799076:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.799102:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd2082cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.799175:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563581952 00000100:00100000:3.0:1783562300.799181:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563581952 00000100:00100000:3.0:1783562300.799214:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783562300.799221:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563581952:12345-0@lo:501: 00000100:00100000:3.0:1783562300.799766:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563581952:12345-0@lo:501: Request processed in 545us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.799772:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783562300.800295:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563581952:0@lo:501: 00000100:00100000:0.0:1783562300.800626:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582080:0@lo:503: 00000100:00100000:0.0:1783562300.800677:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.800749:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0da80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.800783:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582080 00000100:00100000:1.0:1783562300.800789:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582080 00000100:00100000:1.0:1783562300.800919:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783562300.800929:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563582080:12345-0@lo:503: 00000100:00100000:1.0:1783562300.801238:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563582080:12345-0@lo:503: Request processed in 311us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562300.801246:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783562300.801502:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582080:0@lo:503: 00000100:00100000:0.0:1783562300.801873:0:7873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7873:1870200563582208:0@lo:502: 00000100:00100000:0.0:1783562300.801922:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.802000:0:7873:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.802033:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582208 00000100:00100000:1.0:1783562300.802039:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582208 00000100:00100000:1.0:1783562300.802101:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783562300.802109:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:7873:x1870200563582208:12345-0@lo:502: 00000100:00100000:1.0:1783562300.802304:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:7873:x1870200563582208:12345-0@lo:502: Request processed in 194us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562300.802310:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783562300.802938:0:7873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7873:1870200563582208:0@lo:502: 00000020:01000000:3.0:1783562300.802967:0:7873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562300.803391:0:7873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562300.803395:0:7873:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783562300.803430:0:7873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783562300.803432:0:7873:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783562300.803471:0:7873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7873:1870200563582336:0@lo:502: 00000100:00100000:3.0:1783562300.803521:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.803557:0:7873:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.803711:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582336 00000100:00100000:1.0:1783562300.803717:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582336 00000100:00100000:1.0:1783562300.803756:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783562300.803765:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:7873:x1870200563582336:12345-0@lo:502: 00000100:00100000:1.0:1783562300.803941:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:7873:x1870200563582336:12345-0@lo:502: Request processed in 177us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562300.803948:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783562300.805678:0:7873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7873:1870200563582336:0@lo:502: 00000020:01000000:3.0:1783562300.805729:0:7873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562300.805741:0:7873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562300.805743:0:7873:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783562300.805761:0:7873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1783562300.806435:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783562300.806458:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783562300.806480:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.806512:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562300.806525:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783562300.806529:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc78df800 from 30 10000000:01000000:1.0:1783562300.806533:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562300.806585:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.806593:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.806602:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.806621:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582464:0@lo:101: 00000100:00100000:1.0:1783562300.806686:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.806723:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.809316:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582464 00000100:00100000:3.0:1783562300.809348:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582464 00000100:00100000:3.0:1783562300.809429:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783562300.809443:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563582464:12345-0@lo:101: 00010000:00010000:3.0:1783562300.809474:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562300.809497:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d52 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.809532:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.809545:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.809555:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337000, rc 0) 00000100:00100000:3.0:1783562300.809648:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563582464:12345-0@lo:101: Request processed in 208us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.809655:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783562300.809867:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582464:0@lo:101: 00010000:00010000:1.0:1783562300.809889:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.809899:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.809986:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582592:0@lo:501: 00000100:00100000:1.0:1783562300.810020:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.810101:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562300.812241:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582592 00000100:00100000:0.0:1783562300.812258:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582592 00000100:00100000:0.0:1783562300.812328:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783562300.812341:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563582592:12345-0@lo:501: 00000100:00100000:0.0:1783562300.812957:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563582592:12345-0@lo:501: Request processed in 617us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562300.812967:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783562300.814087:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582592:0@lo:501: 00000100:00100000:1.0:1783562300.814150:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582720:0@lo:503: 00000100:00100000:1.0:1783562300.814207:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.814260:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.815933:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582720 00000100:00100000:2.0:1783562300.815944:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582720 00000100:00100000:2.0:1783562300.816004:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783562300.816017:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563582720:12345-0@lo:503: 00000100:00100000:2.0:1783562300.816249:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563582720:12345-0@lo:503: Request processed in 234us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.816257:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783562300.816378:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563582720:0@lo:503: 00000100:00100000:1.0:1783562300.817600:0:7875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7875:1870200563582848:0@lo:502: 00000100:00100000:1.0:1783562300.817694:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.817746:0:7875:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.818710:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582848 00000100:00100000:3.0:1783562300.818724:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582848 00000100:00100000:3.0:1783562300.818772:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783562300.818781:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:7875:x1870200563582848:12345-0@lo:502: 00000100:00100000:3.0:1783562300.819113:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:7875:x1870200563582848:12345-0@lo:502: Request processed in 331us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.819121:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783562300.819677:0:7875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7875:1870200563582848:0@lo:502: 00000100:00100000:2.0:1783562300.819750:0:7875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7875:1870200563582976:0@lo:502: 00000100:00100000:2.0:1783562300.819793:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.820055:0:7875:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.822699:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563582976 00000100:00100000:3.0:1783562300.822716:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563582976 00000100:00100000:3.0:1783562300.822787:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783562300.822806:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:7875:x1870200563582976:12345-0@lo:502: 00000100:00100000:3.0:1783562300.823214:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:7875:x1870200563582976:12345-0@lo:502: Request processed in 410us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.823224:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783562300.823649:0:7875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7875:1870200563582976:0@lo:502: 00000040:00080000:2.0:1783562300.823700:0:7875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783562300.823806:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783562300.823832:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562300.823848:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.823861:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562300.823874:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783562300.823877:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcc78df800 from 5 10000000:01000000:1.0:1783562300.823880:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783562300.823923:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.823931:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562300.823942:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562300.823976:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583104:0@lo:101: 00000100:00100000:1.0:1783562300.824023:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.824066:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.824072:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583104 00000100:00100000:2.0:1783562300.824079:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583104 00000100:00100000:2.0:1783562300.824191:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783562300.824202:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563583104:12345-0@lo:101: 00010000:00010000:2.0:1783562300.824215:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562300.824231:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3c00/0x4738ba0933b87d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d60 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.824257:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3c00/0x4738ba0933b87d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d60 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.824269:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3c00/0x4738ba0933b87d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d60 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.824280:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3c00, rc 0) 00000100:00100000:2.0:1783562300.824326:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563583104:12345-0@lo:101: Request processed in 127us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.824333:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783562300.824426:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583104:0@lo:101: 00010000:00010000:3.0:1783562300.824440:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.824448:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562300.824504:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583232:0@lo:256: 00000100:00100000:3.0:1783562300.824541:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.827813:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583232 00000100:00100000:1.0:1783562300.827824:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583232 00000100:00100000:0.0:1783562300.828443:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783562300.828456:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563583232:12345-0@lo:256: 20000000:01000000:0.0:1783562300.828497:0:5750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783562300.828518:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783562300.828522:0:5750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783562300.828690:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563583232:12345-0@lo:256: Request processed in 235us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562300.828699:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783562300.828805:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.828831:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583232:0@lo:256: 10000000:01000000:3.0:1783562300.828892:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783562300.828904:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.828915:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562300.828924:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783562300.828927:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783562300.828930:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562300.828967:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.828985:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.828995:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562300.829091:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583360:0@lo:101: 00000100:00100000:3.0:1783562300.829126:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.829151:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.829318:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583360 00000100:00100000:2.0:1783562300.829325:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583360 00000100:00100000:2.0:1783562300.829372:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783562300.829381:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563583360:12345-0@lo:101: 00010000:00010000:2.0:1783562300.829390:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562300.829439:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d6e expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.829473:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.829498:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562300.829508:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3200, rc 0) 00000100:00100000:2.0:1783562300.829542:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563583360:12345-0@lo:101: Request processed in 163us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.829549:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783562300.832715:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583360:0@lo:101: 00010000:00010000:3.0:1783562300.832748:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.832762:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562300.832884:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583488:0@lo:501: 00000100:00100000:3.0:1783562300.832948:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.832986:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.833006:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583488 00000100:00100000:3.0:1783562300.833011:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583488 00000100:00100000:3.0:1783562300.833055:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783562300.833064:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563583488:12345-0@lo:501: 00000100:00100000:3.0:1783562300.833901:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563583488:12345-0@lo:501: Request processed in 834us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.833911:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783562300.834012:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583488:0@lo:501: 00000100:00100000:2.0:1783562300.834063:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583616:0@lo:503: 00000100:00100000:2.0:1783562300.834111:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.834152:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.834169:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583616 00000100:00100000:3.0:1783562300.834174:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583616 00000100:00100000:3.0:1783562300.834212:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783562300.834222:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563583616:12345-0@lo:503: 00000100:00100000:2.0:1783562300.835216:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563583616:12345-0@lo:503: Request processed in 992us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.835226:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783562300.835492:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563583616:0@lo:503: 00000100:00100000:3.0:1783562300.837375:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7878:1870200563583744:0@lo:502: 00000100:00100000:3.0:1783562300.838896:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.838947:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.839195:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583744 00000100:00100000:2.0:1783562300.839204:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583744 00000100:00100000:2.0:1783562300.839254:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783562300.839262:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:7878:x1870200563583744:12345-0@lo:502: 00000100:00100000:2.0:1783562300.839636:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:7878:x1870200563583744:12345-0@lo:502: Request processed in 373us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.839644:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783562300.840171:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7878:1870200563583744:0@lo:502: 00000020:01000000:1.0:1783562300.840209:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562300.840217:0:7878:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783562300.840225:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562300.840227:0:7878:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783562300.840233:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783562300.840237:0:7878:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:1.0:1783562300.840262:0:7878:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783562300.840266:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562300.840284:0:7878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bfcef648000) 00000020:00000080:1.0:1783562300.840309:0:7878:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783562300.840316:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783562300.840397:0:7878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783562300.840437:0:7878:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783562300.840444:0:7878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b87d83 00010000:00080000:1.0:1783562300.840486:0:7878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcef650800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562300.842338:0:7878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783562300.842813:0:7878:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783562300.842833:0:7878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783562300.843653:0:7878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562300.843895:0:7878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562300.843943:0:7878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783562300.845558:0:7878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783562300.853971:0:7879:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562300.853982:0:7879:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783562300.855692:0:7878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783562300.855707:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783562300.855738:0:7878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783562300.855770:0:7878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b87d8a 00000100:00080000:2.0:1783562300.855781:0:7878:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783562300.855787:0:7878:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcef650800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:2.0:1783562300.855823:0:7878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcf70d9880 x1870200563583872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783562300.855850:0:7878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783562300.855921:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562300.855926:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562300.855928:0:7878:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783562300.855932:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562300.855936:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562300.855938:0:7878:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783562300.855941:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783562300.855943:0:7878:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783562300.855977:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7878:1870200563584000:0@lo:502: 00000100:00100000:2.0:1783562300.856139:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.856179:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e480 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.856207:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584000 00000100:00100000:2.0:1783562300.856215:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584000 00000100:00100000:2.0:1783562300.856255:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783562300.856264:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:7878:x1870200563584000:12345-0@lo:502: 00000100:00100000:2.0:1783562300.856560:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:7878:x1870200563584000:12345-0@lo:502: Request processed in 294us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.856568:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783562300.856639:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:7878:1870200563584000:0@lo:502: 00000020:01000000:2.0:1783562300.856669:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562300.856674:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562300.856676:0:7878:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783562300.856682:0:7878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1783562300.856881:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563583872:0@lo:8: 00000100:00100000:0.0:1783562300.856923:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783562300.856966:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783562300.856986:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783562300.856999:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562300.857024:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562300.857035:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783562300.857037:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfcc3f199c0 from 1 10000000:01000000:0.0:1783562300.857040:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783562300.858191:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562300.858208:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562300.858219:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562300.858241:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563584128:0@lo:101: 00000100:00100000:0.0:1783562300.858291:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.858316:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.858540:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563584640:0@lo:400: 00000100:00100000:3.0:1783562300.858575:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.858600:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562300.858605:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563584256:0@lo:400: 00000100:00100000:3.0:1783562300.858624:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.858645:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563584384:0@lo:400: 00000100:00100000:3.0:1783562300.858666:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.858681:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562300.858685:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563584512:0@lo:400: 00000100:00100000:3.0:1783562300.858710:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.858738:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584640 00000100:00100000:3.0:1783562300.858745:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584640 00000100:00100000:3.0:1783562300.858787:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584256 00000100:00100000:3.0:1783562300.858790:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584256 00000100:00100000:3.0:1783562300.858800:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584384 00000100:00100000:3.0:1783562300.858802:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584384 00000100:00100000:3.0:1783562300.858815:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562300.858824:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563584640:12345-0@lo:400: 00000100:00100000:3.0:1783562300.858882:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563584640:12345-0@lo:400: Request processed in 58us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.858901:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562300.858920:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562300.858925:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563584256:12345-0@lo:400: 00000100:00100000:3.0:1783562300.858954:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563584256:12345-0@lo:400: Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.858960:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562300.858972:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562300.858978:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563584384:12345-0@lo:400: 00000100:00100000:3.0:1783562300.859008:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563584384:12345-0@lo:400: Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.859013:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562300.859037:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563583872 00000100:00100000:3.0:1783562300.859041:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563583872 00000100:00100000:3.0:1783562300.859143:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584512 00000100:00100000:3.0:1783562300.859147:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584512 00000100:00100000:3.0:1783562300.859170:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562300.859175:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563584512:12345-0@lo:400: 00000100:00100000:3.0:1783562300.859205:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563584512:12345-0@lo:400: Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.859212:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562300.859223:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562300.859228:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3271:x1870200563583872:12345-0@lo:8: 00010000:00080000:3.0:1783562300.859255:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 110 last 0 00000020:00000080:3.0:1783562300.859291:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b87d98 00002000:00100000:3.0:1783562300.859310:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bfcf7131800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783562300.859324:0:6608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1783562300.859329:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783562300.859528:0:6608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783562300.859700:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783562300.859734:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9bfcf7132000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562300.859785:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563583872:12345-0@lo:8: Request processed in 555us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.859792:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783562300.859844:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69b800 x1870200563584256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562300.859861:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563584256:0@lo:400: 00010000:00080000:3.0:1783562300.859875:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69ad80 x1870200563584640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562300.859883:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563584640:0@lo:400: 00010000:00080000:3.0:1783562300.859921:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef698a80 x1870200563584512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562300.859931:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563584512:0@lo:400: 00010000:00080000:3.0:1783562300.859943:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69a300 x1870200563584384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562300.859950:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563584384:0@lo:400: 00010000:00080000:3.0:1783562300.859991:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70d9880 x1870200563583872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562300.860000:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783562300.860007:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783562300.860026:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783562300.860032:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783562300.860036:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef650800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783562300.860828:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783562300.860839:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563583872:0@lo:8: 00000100:00100000:3.0:1783562300.860873:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584128 00000100:00100000:3.0:1783562300.860881:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584128 00000100:00100000:3.0:1783562300.860922:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783562300.860932:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563584128:12345-0@lo:101: 00010000:00010000:3.0:1783562300.860944:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562300.860968:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87d91 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.860999:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.861011:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.861022:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336c00, rc 0) 00000100:00100000:3.0:1783562300.861095:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563584128:12345-0@lo:101: Request processed in 163us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.861101:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783562300.861150:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563584128:0@lo:101: 00010000:00010000:3.0:1783562300.861168:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.861179:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562300.861266:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563584768:0@lo:501: 00000100:00100000:3.0:1783562300.861304:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.861335:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562300.861349:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584768 00000100:00100000:3.0:1783562300.861352:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584768 00000100:00100000:3.0:1783562300.861373:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783562300.861379:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563584768:12345-0@lo:501: 00000100:00100000:3.0:1783562300.861641:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563584768:12345-0@lo:501: Request processed in 261us (335us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783562300.861649:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783562300.861680:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563584768:0@lo:501: 10000000:01000000:3.0:1783562300.861705:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783562300.861712:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562300.861720:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562300.861999:0:7879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783562300.862139:0:7879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 110118735817ns, next at 0ns, rc = 0 00000004:00080000:0.0:1783562300.908091:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783562300.910747:0:7881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783562300.910750:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563584896:0@lo:13: 00000100:00100000:3.0:1783562300.910776:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585024:0@lo:7: 00000100:00100000:3.0:1783562300.910849:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562300.910850:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562300.910897:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585024 00000100:00100000:3.0:1783562300.910906:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585024 00000100:00100000:3.0:1783562300.910971:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562300.911504:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563584896 00000100:00100000:0.0:1783562300.911510:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563584896 00000100:00100000:0.0:1783562300.911543:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562300.911551:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563584896:12345-0@lo:13: 00002000:00000024:0.0:1783562300.911590:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783562300.911643:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563584896:12345-0@lo:13: Request processed in 92us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562300.911660:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783562300.911687:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783562300.911722:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69a300 x1870200563584896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562300.911742:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563584896:0@lo:13: 00000100:00100000:3.0:1783562300.911908:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7881:x1870200563585024:12345-0@lo:7: 00000100:00100000:2.0:1783562300.914508:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f000 going to sleep for 11 seconds 00002000:00080000:3.0:1783562300.922632:0:6608:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783562300.922644:0:6608:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783562300.922770:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7881:x1870200563585024:12345-0@lo:7: Request processed in 10860us (11922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562300.922782:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783562300.923252:0:7881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef698a80 x1870200563585024/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783562316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562300.923269:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585024:0@lo:7: 00000004:00080000:2.0:1783562300.923286:0:7881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783562300.923333:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585152:0@lo:5: 00000100:00100000:2.0:1783562300.923373:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.923440:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.923594:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585152 00000100:00100000:1.0:1783562300.923604:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585152 00000100:00100000:1.0:1783562300.923670:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783562300.923681:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7881:x1870200563585152:12345-0@lo:5: 00002000:00080000:1.0:1783562300.923718:0:6550:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783562300.923723:0:6550:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783562300.924116:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7881:x1870200563585152:12345-0@lo:5: Request processed in 437us (742us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783562300.924123:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783562300.924251:0:7881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70d9180 x1870200563585152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562300.924266:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585152:0@lo:5: 00000004:00080000:2.0:1783562300.924275:0:7881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783562300.924306:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585280:0@lo:700: 00000100:00100000:2.0:1783562300.924334:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562300.924363:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562300.924859:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585280 00000100:00100000:1.0:1783562300.924866:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585280 00000100:00100000:1.0:1783562300.924908:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562300.924917:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7881:x1870200563585280:12345-0@lo:700: 00000100:00100000:1.0:1783562300.924956:0:6556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6556:1870200563585408:0@lo:700: 00000100:00100000:1.0:1783562300.924992:0:6556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562300.925133:0:6556:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562300.925260:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585408 00000100:00100000:2.0:1783562300.925265:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585408 00000100:00100000:2.0:1783562300.925311:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562300.925319:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6556:x1870200563585408:12345-0@lo:700: 40000000:02000000:3.0:1783562300.974274:0:5761:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783562300.982378:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6556:x1870200563585408:12345-0@lo:700: Request processed in 57049us (57374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562300.982393:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783562300.982680:0:6556:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7122d80 x1870200563585408/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783562316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562300.982700:0:6556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6556:1870200563585408:0@lo:700: 40000000:02000000:1.0:1783562300.982715:0:6556:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1783562301.061142:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7881:x1870200563585280:12345-0@lo:700: Request processed in 136211us (136791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562301.061164:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1783562301.061213:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783562301.061228:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1783562301.061306:0:7881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70db100 x1870200563585280/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783562316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562301.061338:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585280:0@lo:700: 00000004:02000040:1.0:1783562301.097587:0:7881:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1783562301.103519:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585536:0@lo:5: 00000100:00100000:1.0:1783562301.103615:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562301.103671:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585536 00000100:00100000:1.0:1783562301.103680:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585536 00000100:00100000:1.0:1783562301.103754:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562301.103765:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7881:x1870200563585536:12345-0@lo:5: 00000100:00100000:0.0:1783562301.106481:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc2185600 going to sleep for 11 seconds 00002000:00080000:0.0:1783562301.116244:0:6549:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783562301.116276:0:6549:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783562301.126081:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7881:x1870200563585536:12345-0@lo:5: Request processed in 22300us (22448us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783562301.126102:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783562301.126186:0:7881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7122d80 x1870200563585536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562317 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562301.126206:0:7881:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783562301.126230:0:7881:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfcf7122d80 x1870200563585536/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562317 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562301.126245:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7881:1870200563585536:0@lo:5: 00000004:00080000:0.0:1783562301.126271:0:7881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1783562301.305924:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562301.305966:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563585664:0@lo:13: 00000100:00100000:0.0:1783562301.306081:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562301.306157:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585664 00000100:00100000:1.0:1783562301.306170:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585664 00000100:00100000:1.0:1783562301.306440:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562301.306468:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563585664:12345-0@lo:13: 00002000:00000024:1.0:1783562301.306534:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562301.306605:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563585664:12345-0@lo:13: Request processed in 154us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562301.306614:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783562301.306991:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcd0f70a80 x1870200563585664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562301.307017:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd0f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563585664:0@lo:13: 00010000:00010000:0.0:1783562301.366827:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562302.390757:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562303.424166:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783562303.550891:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1783562303.889139:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562303.889391:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553078912 00000100:00100000:0.0:1783562303.889426:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553078912 00000100:00100000:0.0:1783562303.889487:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:0.0:1783562303.889496:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1870200553078912:12345-192.168.204.4@tcp:250: 00010000:00080000:0.0:1783562303.889530:0:5749:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ea73df88-a302-4824-bca9-4d5c686fd328@192.168.204.4@tcp t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:0.0:1783562303.889566:0:5749:0:(genops.c:1406:class_connect()) connect: client ea73df88-a302-4824-bca9-4d5c686fd328, cookie 0x4738ba0933b87da6 00000100:00080000:0.0:1783562303.889739:0:5749:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562303.889824:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+5:2360:x1870200553078912:12345-192.168.204.4@tcp:250: Request processed in 327us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562303.889833:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:1.0:1783562303.902534:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562303.902876:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079040 00000100:00100000:0.0:1783562303.902891:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079040 00000100:00100000:0.0:1783562303.902960:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:0.0:1783562303.902973:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+5:5559:x1870200553079040:12345-192.168.204.4@tcp:101: 00010000:00010000:0.0:1783562303.902991:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562303.903013:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21086 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.903049:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 6 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.903063:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 6 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.903074:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9200, rc 0) 00000100:00100000:0.0:1783562303.903131:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+6:5559:x1870200553079040:12345-192.168.204.4@tcp:101: Request processed in 160us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562303.903138:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:3.0:1783562303.905917:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562303.905972:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079168 00000100:00100000:0.0:1783562303.906000:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079168 00000100:00100000:0.0:1783562303.906069:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:0.0:1783562303.906081:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+6:5559:x1870200553079168:12345-192.168.204.4@tcp:501: 00000100:00100000:0.0:1783562303.907153:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+6:5559:x1870200553079168:12345-192.168.204.4@tcp:501: Request processed in 1070us (1242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783562303.907164:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:3.0:1783562303.909503:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562303.909568:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079296 00000100:00100000:1.0:1783562303.909582:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079296 00000100:00100000:1.0:1783562303.909643:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:1.0:1783562303.909654:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+6:5559:x1870200553079296:12345-192.168.204.4@tcp:101: 00010000:00010000:1.0:1783562303.909696:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562303.909719:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2108d expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562303.909769:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 7 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562303.909782:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 7 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562303.909793:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498200, rc 0) 00000100:00100000:1.0:1783562303.909854:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+7:5559:x1870200553079296:12345-192.168.204.4@tcp:101: Request processed in 200us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562303.909863:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:1.0:1783562303.911653:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.911734:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079424 00000100:00100000:3.0:1783562303.911743:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079424 00000100:00100000:3.0:1783562303.911796:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:3.0:1783562303.911805:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+7:5559:x1870200553079424:12345-192.168.204.4@tcp:501: 00000100:00100000:3.0:1783562303.912210:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+8:5559:x1870200553079424:12345-192.168.204.4@tcp:501: Request processed in 404us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.912218:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:2.0:1783562303.924030:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.924085:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079552 00000100:00100000:3.0:1783562303.924100:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079552 00000100:00100000:3.0:1783562303.924364:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:3.0:1783562303.924376:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+8:5559:x1870200553079552:12345-192.168.204.4@tcp:503: 00000100:00100000:3.0:1783562303.924886:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+8:5559:x1870200553079552:12345-192.168.204.4@tcp:503: Request processed in 510us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.924896:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:2.0:1783562303.929187:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.929226:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079680 00000100:00100000:3.0:1783562303.929237:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079680 00000100:00100000:3.0:1783562303.929298:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:3.0:1783562303.929308:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+8:5578:x1870200553079680:12345-192.168.204.4@tcp:502: 00000100:00100000:3.0:1783562303.929795:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+8:5578:x1870200553079680:12345-192.168.204.4@tcp:502: Request processed in 488us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.929861:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:0.0:1783562303.963106:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.963147:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079808 00000100:00100000:3.0:1783562303.963159:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079808 00000100:00100000:3.0:1783562303.963249:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:3.0:1783562303.963262:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+8:5578:x1870200553079808:12345-192.168.204.4@tcp:502: 00000100:00100000:3.0:1783562303.963836:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+8:5578:x1870200553079808:12345-192.168.204.4@tcp:502: Request processed in 573us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.963847:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:2.0:1783562303.969889:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.970176:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553079936 00000100:00100000:3.0:1783562303.970189:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553079936 00000100:00100000:3.0:1783562303.970244:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:3.0:1783562303.970255:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+8:5559:x1870200553079936:12345-192.168.204.4@tcp:101: 00010000:00010000:3.0:1783562303.970275:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562303.970296:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337a00/0x4738ba0933b87dbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210b7 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562303.970332:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337a00/0x4738ba0933b87dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210b7 expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562303.970348:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337a00/0x4738ba0933b87dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210b7 expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562303.970373:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337a00, rc 0) 00000100:00100000:3.0:1783562303.970489:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:5559:x1870200553079936:12345-192.168.204.4@tcp:101: Request processed in 234us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.970497:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:2.0:1783562303.973125:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562303.973315:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080064 00000100:00100000:1.0:1783562303.973326:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080064 00000100:00100000:1.0:1783562303.973381:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:1.0:1783562303.973390:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+9:5559:x1870200553080064:12345-192.168.204.4@tcp:256: 20000000:01000000:1.0:1783562303.973458:0:5748:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783562303.973485:0:5748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783562303.973489:0:5748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783562303.973492:0:5748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783562303.973494:0:5748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783562303.976860:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+9:5559:x1870200553080064:12345-192.168.204.4@tcp:256: Request processed in 3458us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.976876:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:3.0:1783562303.980140:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562303.980439:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080192 00000100:00100000:0.0:1783562303.980455:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080192 00000100:00100000:0.0:1783562303.980538:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:0.0:1783562303.980550:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:5559:x1870200553080192:12345-192.168.204.4@tcp:101: 00010000:00010000:0.0:1783562303.980573:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562303.980598:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210be expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.980637:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.980652:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562303.980665:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562303.980733:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5559:x1870200553080192:12345-192.168.204.4@tcp:101: Request processed in 185us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562303.980740:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:1.0:1783562303.984651:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.991062:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080320 00000100:00100000:3.0:1783562303.991085:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080320 00000100:00100000:3.0:1783562303.991165:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:3.0:1783562303.991177:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5559:x1870200553080320:12345-192.168.204.4@tcp:501: 00000100:00100000:3.0:1783562303.991678:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5559:x1870200553080320:12345-192.168.204.4@tcp:501: Request processed in 502us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.991688:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:0.0:1783562303.994705:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562303.994763:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080448 00000100:00100000:3.0:1783562303.994775:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080448 00000100:00100000:3.0:1783562303.994849:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:3.0:1783562303.994861:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:5559:x1870200553080448:12345-192.168.204.4@tcp:503: 00000100:00100000:3.0:1783562303.995230:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:5559:x1870200553080448:12345-192.168.204.4@tcp:503: Request processed in 369us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562303.995239:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:3.0:1783562304.002013:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562304.002059:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080576 00000100:00100000:3.0:1783562304.002071:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080576 00000100:00100000:3.0:1783562304.002127:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:3.0:1783562304.002137:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5585:x1870200553080576:12345-192.168.204.4@tcp:502: 00000100:00100000:3.0:1783562304.002716:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5585:x1870200553080576:12345-192.168.204.4@tcp:502: Request processed in 577us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562304.002727:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:2.0:1783562304.005714:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562304.005985:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080704 00000100:00100000:3.0:1783562304.005996:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080704 00000100:00100000:3.0:1783562304.006043:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:3.0:1783562304.006053:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5585:x1870200553080704:12345-192.168.204.4@tcp:502: 00000100:00100000:3.0:1783562304.006382:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5585:x1870200553080704:12345-192.168.204.4@tcp:502: Request processed in 329us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562304.006390:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:0.0:1783562304.009879:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562304.010239:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080832 00000100:00100000:3.0:1783562304.010250:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080832 00000100:00100000:3.0:1783562304.010351:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562304.010372:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1870200553080832:12345-192.168.204.4@tcp:38: 00010000:00080000:3.0:1783562304.010428:0:6572:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:3.0:1783562304.010479:0:6572:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b87dc9 00000004:00100000:3.0:1783562304.010508:0:6572:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783562304.010514:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783562304.050660:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6944000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562304.051245:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553080832:12345-192.168.204.4@tcp:38: Request processed in 40405us (40896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562304.051259:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00010000:00010000:0.0:1783562304.438824:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562305.060285:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562305.060627:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553080960 00000100:00100000:3.0:1783562305.060652:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553080960 00000100:00100000:3.0:1783562305.060807:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562305.060823:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:0:x1870200553080960:12345-192.168.204.4@tcp:41: 00000100:00080000:1.0:1783562305.060828:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1783562305.060894:0:5756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783562305.061003:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:0:x1870200553080960:12345-192.168.204.4@tcp:41: Request processed in 183us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562305.061012:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562305.061080:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562305.061689:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081088 00000100:00100000:3.0:1783562305.061698:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081088 00000100:00100000:3.0:1783562305.062187:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:3.0:1783562305.062199:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081088:12345-192.168.204.4@tcp:41: 00000004:00000024:3.0:1783562305.062228:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783562305.062299:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081088:12345-192.168.204.4@tcp:41: Request processed in 101us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562305.062308:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562305.064724:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562305.064826:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081216 00000100:00100000:2.0:1783562305.064837:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081216 00000100:00100000:2.0:1783562305.064967:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:2.0:1783562305.064980:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081216:12345-192.168.204.4@tcp:40: 00000100:00100000:2.0:1783562305.065103:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081216:12345-192.168.204.4@tcp:40: Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562305.065109:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562305.068522:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562305.068606:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081344 00000100:00100000:2.0:1783562305.068620:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081344 00000100:00100000:1.0:1783562305.068667:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562305.068679:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:2.0:1783562305.068692:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553081344:12345-192.168.204.4@tcp:8: 00010000:00080000:2.0:1783562305.068736:0:6547:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 114 last 0 00000100:00100000:1.0:1783562305.068765:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000020:00000080:2.0:1783562305.068783:0:6547:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b87dd0 00002000:00100000:2.0:1783562305.068800:0:6547:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aeded353-5c04-404d-8ca0-d71cfbeced3d/ffff9bfcf6167800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1783562305.068821:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00002000:00100000:2.0:1783562305.068828:0:6547:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783562305.068951:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081600 00000100:00100000:3.0:1783562305.068957:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081600 00000100:00100000:3.0:1783562305.068996:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562305.069003:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870200553081600:12345-192.168.204.4@tcp:8: 00010000:00080000:3.0:1783562305.069025:0:6550:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 114 last 0 00000020:00000080:3.0:1783562305.069055:0:6550:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b87dd7 00002000:00100000:3.0:1783562305.069064:0:6550:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aeded353-5c04-404d-8ca0-d71cfbeced3d/ffff9bfbc6946800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783562305.069087:0:6550:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783562305.069277:0:6547:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783562305.069313:0:6547:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6166800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562305.069359:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081472 00000100:00100000:0.0:1783562305.069366:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081472 00000100:00100000:2.0:1783562305.069390:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553081344:12345-192.168.204.4@tcp:8: Request processed in 690us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562305.069398:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:2.0:1783562305.069448:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081728 00000100:00100000:2.0:1783562305.069451:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081728 00002000:00080000:3.0:1783562305.069476:0:6550:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1783562305.069482:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:2.0:1783562305.069489:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081728:12345-192.168.204.4@tcp:33: 00000100:00080000:3.0:1783562305.069500:0:6550:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6941000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562305.069535:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553081600:12345-192.168.204.4@tcp:8: Request processed in 531us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562305.069547:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 120 00000100:00100000:0.0:1783562305.069558:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2361:x1870200553081472:12345-192.168.204.4@tcp:400: 00000100:00100000:3.0:1783562305.069572:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:0.0:1783562305.069602:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2361:x1870200553081472:12345-192.168.204.4@tcp:400: Request processed in 44us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562305.069612:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 120 00000004:00080000:0.0:1783562305.080787:0:5757:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11223us 00000004:00200000:0.0:1783562305.094134:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783562305.094364:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5559:x1870200553081728:12345-192.168.204.4@tcp:33: Request processed in 24865us (25589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562305.094396:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562305.251642:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562305.251761:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081856 00000100:00100000:0.0:1783562305.251774:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081856 00000100:00100000:3.0:1783562305.251887:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562305.251967:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5602:x1870200553081856:12345-192.168.204.4@tcp:101: 00010000:00010000:3.0:1783562305.251997:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562305.252036:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b87dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210e8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.252127:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.252143:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.252235:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562305.253047:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783562305.253058:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562305.253299:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.253351:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b87dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210e8 expref: 8 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.253483:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210e8 expref: 7 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562305.253496:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89eab00) 00010000:00010000:3.0:1783562305.253500:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562305.253515:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:3.0:1783562305.256783:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:5602:x1870200553081856:12345-192.168.204.4@tcp:101: Request processed in 4861us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562305.256801:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:0.0:1783562305.462706:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562305.911457:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563586048:0@lo:400: 00000100:00100000:1.0:1783562305.911625:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562305.911714:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783562305.911721:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563585920:0@lo:400: 00000100:00100000:1.0:1783562305.911745:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562305.911766:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563586432:0@lo:400: 00000100:00100000:1.0:1783562305.911791:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562305.911837:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586048 00000100:00100000:1.0:1783562305.911848:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586048 00000100:00100000:1.0:1783562305.911917:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585920 00000100:00100000:1.0:1783562305.911920:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585920 00000100:00100000:1.0:1783562305.911938:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562305.911946:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563586048:12345-0@lo:400: 00000100:00100000:1.0:1783562305.912005:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563586048:12345-0@lo:400: Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562305.912013:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562305.912033:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562305.912038:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563585920:12345-0@lo:400: 00000100:00100000:1.0:1783562305.912059:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563585920:12345-0@lo:400: Request processed in 21us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562305.912064:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1783562305.912080:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562305.912302:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563585920:0@lo:400: 00000100:00100000:1.0:1783562305.912315:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563586048:0@lo:400: 00000100:00100000:3.0:1783562305.912332:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563585792:0@lo:400: 00000100:00100000:3.0:1783562305.912425:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562305.912448:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586432 00000100:00100000:1.0:1783562305.912448:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563586176:0@lo:400: 00000100:00100000:2.0:1783562305.912457:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586432 00000100:00100000:3.0:1783562305.912463:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563586304:0@lo:400: 00000100:00100000:1.0:1783562305.912492:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562305.912507:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562305.912524:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586176 00000100:00100000:2.0:1783562305.912529:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586176 00000100:00100000:1.0:1783562305.912557:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562305.912558:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563585792 00000100:00100000:3.0:1783562305.912565:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563585792 00000100:00100000:2.0:1783562305.912568:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562305.912573:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563586432:12345-0@lo:400: 00000100:00100000:2.0:1783562305.912584:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563586176:12345-0@lo:400: 00000100:00100000:3.0:1783562305.912607:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783562305.912619:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563585792:12345-0@lo:400: 00000100:00100000:1.0:1783562305.912628:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563586432:12345-0@lo:400: Request processed in 60us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562305.912637:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783562305.912657:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563586176:12345-0@lo:400: Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562305.912667:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562305.912676:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563585792:12345-0@lo:400: Request processed in 59us (274us total) trans 0 rc 0/0 00000100:00080000:1.0:1783562305.912678:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562305.912685:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562305.912690:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1783562305.912718:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7120380 x1870200563586176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783562305.912720:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7123800 x1870200563586432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562305.912744:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563585792:0@lo:400: 00000100:00100000:2.0:1783562305.912751:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563586176:0@lo:400: 00000100:00100000:1.0:1783562305.912751:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783562305.912773:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586304 00000100:00100000:1.0:1783562305.912774:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563586432:0@lo:400: 00000100:00100000:3.0:1783562305.912777:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586304 00000100:00080000:1.0:1783562305.912811:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562305.912822:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562305.912831:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563586304:12345-0@lo:400: 00000100:00100000:3.0:1783562305.912877:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563586304:12345-0@lo:400: Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562305.912884:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783562305.912927:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563586304:0@lo:400: 00000100:00100000:1.0:1783562306.423346:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563586560:0@lo:13: 00000100:00100000:1.0:1783562306.423501:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562306.423657:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586560 00000100:00100000:3.0:1783562306.423670:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586560 00000100:00100000:3.0:1783562306.423748:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783562306.423761:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563586560:12345-0@lo:13: 00002000:00000024:3.0:1783562306.423812:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562306.423878:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562306.423896:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563586688:0@lo:13: 00000100:00100000:0.0:1783562306.423946:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562306.424095:0:6552:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1783562306.424106:0:6552:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1783562306.424502:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563586688 00000100:00100000:2.0:1783562306.424517:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563586688 00000100:00100000:3.0:1783562306.424607:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563586560:12345-0@lo:13: Request processed in 846us (1103us total) trans 0 rc 0/0 00010000:00080000:1.0:1783562306.424614:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e29880 x1870200563586560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562306.424621:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783562306.424646:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563586560:0@lo:13: 00000100:00100000:3.0:1783562306.424654:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562306.424666:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563586688:12345-0@lo:13: 00002000:00000024:3.0:1783562306.424684:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562306.424776:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563586688:12345-0@lo:13: Request processed in 113us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562306.424782:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783562306.424842:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf70d8000 x1870200563586688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562306.424856:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563586688:0@lo:13: 00010000:00010000:0.0:1783562306.487040:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562306.965873:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562306.965980:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553081984 00000100:00100000:3.0:1783562306.965991:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553081984 00000100:00100000:3.0:1783562306.966093:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562306.966103:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:5654:x1870200553081984:12345-192.168.204.4@tcp:41: 00000004:00000024:3.0:1783562306.966147:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783562306.966220:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:5654:x1870200553081984:12345-192.168.204.4@tcp:41: Request processed in 117us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562306.966228:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562306.970088:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562306.970352:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082112 00000100:00100000:2.0:1783562306.970365:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082112 00000100:00100000:2.0:1783562306.970469:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:2.0:1783562306.970480:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5654:x1870200553082112:12345-192.168.204.4@tcp:13: 00002000:00000024:2.0:1783562306.970529:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562306.970597:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5654:x1870200553082112:12345-192.168.204.4@tcp:13: Request processed in 119us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562306.970605:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00080000:1.0:1783562306.971188:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562306.973195:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562306.973293:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082240 00000100:00100000:3.0:1783562306.973304:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082240 00000100:00080000:1.0:1783562306.973450:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562306.973521:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562306.973535:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5654:x1870200553082240:12345-192.168.204.4@tcp:13: 00002000:00000024:3.0:1783562306.973595:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562306.973661:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:5654:x1870200553082240:12345-192.168.204.4@tcp:13: Request processed in 132us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562306.973666:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000001:00100000:3.0:1783562307.489371:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00010000:00010000:0.0:1783562307.510556:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562308.538286:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562308.780951:0:8110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1783562309.525858:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000001:00100000:1.0:1783562309.527377:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00010000:00010000:3.0:1783562309.560674:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562310.077192:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562310.077293:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082368 00000100:00100000:3.0:1783562310.077304:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082368 00000100:00100000:3.0:1783562310.077505:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:3.0:1783562310.077519:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553082368:12345-192.168.204.4@tcp:400: 00000100:00100000:3.0:1783562310.077601:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553082368:12345-192.168.204.4@tcp:400: Request processed in 86us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562310.077609:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:2.0:1783562310.077628:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562310.077654:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562310.077677:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562310.077698:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082496 00000100:00100000:2.0:1783562310.077702:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082496 00000100:00100000:2.0:1783562310.077743:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562310.077751:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553082496:12345-192.168.204.4@tcp:400: 00000100:00100000:2.0:1783562310.077790:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553082496:12345-192.168.204.4@tcp:400: Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.077797:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:3.0:1783562310.077813:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082752 00000100:00100000:3.0:1783562310.077817:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082752 00000100:00080000:2.0:1783562310.077817:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562310.077849:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082624 00000100:00100000:3.0:1783562310.077852:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082624 00000100:00100000:3.0:1783562310.077875:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562310.077881:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553082752:12345-192.168.204.4@tcp:400: 00000100:00100000:2.0:1783562310.077883:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562310.077889:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553082624:12345-192.168.204.4@tcp:400: 00000100:00100000:3.0:1783562310.077911:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553082752:12345-192.168.204.4@tcp:400: Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.077911:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553082624:12345-192.168.204.4@tcp:400: Request processed in 21us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562310.077917:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00080000:1.0:1783562310.078042:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562310.078046:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562310.079781:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00010000:00010000:0.0:1783562310.583451:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562310.938391:0:8260:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7a0db3b0 20000000:00000080:2.0:1783562310.938493:0:8260:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcf6bf1400 uarg=0000000000000000 20000000:01000000:2.0:1783562310.938531:0:8260:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783562310.938533:0:8260:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783562310.938536:0:8260:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783562310.938542:0:8260:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783562310.938546:0:8260:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783562310.938561:0:8260:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783562310.938564:0:8260:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783562310.938792:0:8260:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783562310.938796:0:8260:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783562310.940575:0:8261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1783562310.941355:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1783562310.941442:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1783562310.941502:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1783562310.941752:0:8260:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783562310.941755:0:8260:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783562310.944576:0:8262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783562310.944972:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783562310.945055:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783562310.945094:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783562310.945109:0:8260:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783562310.945112:0:8260:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783562310.945893:0:8263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783562310.946229:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783562310.946293:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783562310.946333:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1783562310.946346:0:8260:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783562310.946349:0:8260:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783562310.947202:0:8264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783562310.947996:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783562310.948062:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783562310.948100:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1783562310.948116:0:8260:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783562310.948137:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948155:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948163:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948170:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948177:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948182:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948189:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948204:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948214:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948222:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948229:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948280:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948296:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 9 pid: 5749 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948313:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563586816:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562310.948516:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948525:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948533:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563586944:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562310.948572:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948590:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 18 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948600:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587072:0@lo:104: 00000100:00100000:2.0:1783562310.948638:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783562310.948669:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948678:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 18 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948686:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587200:0@lo:104: 00000100:00100000:1.0:1783562310.948702:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587072 00000100:00100000:2.0:1783562310.948705:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.948710:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587072 00010000:00010000:2.0:1783562310.948733:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948740:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 18 pid: 5750 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948743:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587200 00000100:00100000:1.0:1783562310.948745:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587200 00000100:00100000:2.0:1783562310.948748:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587328:0@lo:104: 00000100:00100000:1.0:1783562310.948759:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783562310.948768:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.948768:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8260:x1870200563587072:12345-0@lo:104: 00010000:00010000:1.0:1783562310.948780:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948781:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.948789:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 18 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948796:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587456:0@lo:104: 00010000:00010000:1.0:1783562310.948826:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1783562310.948833:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948833:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8260:x1870200563587072:12345-0@lo:104: Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.948839:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783562310.948841:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 18 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948848:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587584:0@lo:104: 00000100:00100000:1.0:1783562310.948860:0:5738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1783562310.948870:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948874:0:5738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783562310.948878:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 18 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948884:0:5738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562310.948885:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587712:0@lo:104: 00000100:00100000:1.0:1783562310.948890:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587328 00000100:00100000:1.0:1783562310.948892:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587328 00000100:00100000:2.0:1783562310.948901:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.948904:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587456 00000100:00100000:1.0:1783562310.948907:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587456 00010000:00010000:2.0:1783562310.948915:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948915:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587584 00000100:00100000:1.0:1783562310.948917:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587584 00010000:00010000:2.0:1783562310.948923:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 18 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.948925:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587712 00000100:00100000:1.0:1783562310.948927:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587712 00000100:00100000:2.0:1783562310.948932:0:8260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587840:0@lo:104: 00000100:00100000:1.0:1783562310.948937:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562310.948941:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:8260:x1870200563587200:12345-0@lo:104: 00000100:00100000:2.0:1783562310.948947:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562310.948949:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.948956:0:8260:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562310.948979:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587072:0@lo:104: 00010000:00010000:1.0:1783562310.948986:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783562310.948987:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587200:0@lo:104: 00000100:00100000:1.0:1783562310.948991:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:8260:x1870200563587200:12345-0@lo:104: Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.948996:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562310.949007:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587840 00000100:00100000:1.0:1783562310.949009:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587840 00000100:00100000:1.0:1783562310.949022:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562310.949027:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:8260:x1870200563587328:12345-0@lo:104: 00010000:00010000:1.0:1783562310.949033:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949073:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783562310.949079:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+7:8260:x1870200563587328:12345-0@lo:104: Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.949085:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562310.949112:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783562310.949118:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:8260:x1870200563587456:12345-0@lo:104: 00010000:00010000:1.0:1783562310.949124:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949146:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783562310.949151:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+6:8260:x1870200563587456:12345-0@lo:104: Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.949156:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783562310.949167:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562310.949173:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:8260:x1870200563587584:12345-0@lo:104: 00010000:00010000:1.0:1783562310.949188:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949213:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783562310.949218:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:8260:x1870200563587584:12345-0@lo:104: Request processed in 46us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.949224:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562310.949236:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562310.949241:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8260:x1870200563587712:12345-0@lo:104: 00010000:00010000:1.0:1783562310.949248:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949283:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783562310.949288:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8260:x1870200563587712:12345-0@lo:104: Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.949293:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562310.949305:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783562310.949310:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:8260:x1870200563587840:12345-0@lo:104: 00010000:00010000:1.0:1783562310.949316:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949338:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783562310.949343:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:8260:x1870200563587840:12345-0@lo:104: Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.949348:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1783562310.949366:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783562310.949372:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949383:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587328:0@lo:104: 00010000:00010000:1.0:1783562310.949384:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949389:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949391:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587456:0@lo:104: 00010000:00010000:1.0:1783562310.949398:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949424:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587584:0@lo:104: 10000000:00010000:1.0:1783562310.949425:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949432:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587712:0@lo:104: 10000000:01000000:1.0:1783562310.949432:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783562310.949438:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563587840:0@lo:104: 00010000:00010000:1.0:1783562310.949462:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949468:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949490:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949497:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8800/0x4738ba0933b87d91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d9f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949504:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563587968:0@lo:103: 00010000:00010000:1.0:1783562310.949508:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783562310.949511:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949517:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336600 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949520:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949532:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562310.949537:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562310.949543:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949549:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562310.949561:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949562:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563587968 00000100:00100000:2.0:1783562310.949565:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563587968 00010000:00010000:1.0:1783562310.949567:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949581:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.949582:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949588:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d75 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949597:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783562310.949600:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949602:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783562310.949606:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499000 already unused, calling callback (ffffffffc1a65c20) 00000100:00100000:2.0:1783562310.949607:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563587968:12345-0@lo:103: 10000000:00010000:1.0:1783562310.949609:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949615:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.949617:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:1.0:1783562310.949621:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.949622:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.949630:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949630:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783562310.949643:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d91 expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949643:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949649:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949654:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.949656:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562310.949661:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d59 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949669:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783562310.949672:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949678:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3275:x1870200563587968:12345-0@lo:103: Request processed in 71us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562310.949678:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949681:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949685:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783562310.949688:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562310.949694:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949698:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562310.949708:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949713:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949724:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949730:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337c00/0x4738ba0933b87d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d4b expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949731:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563587968:0@lo:103: 00010000:00010000:1.0:1783562310.949740:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783562310.949742:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949746:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1783562310.949748:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949751:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949757:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563588352:0@lo:103: 00010000:00010000:1.0:1783562310.949758:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562310.949764:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949769:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783562310.949775:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562310.949780:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949785:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949790:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.949792:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563588480:0@lo:103: 00010000:00010000:1.0:1783562310.949796:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d3d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949805:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1783562310.949808:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562310.949812:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949818:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498e00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949821:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949828:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562310.949834:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949840:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562310.949853:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949859:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949863:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949874:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d13 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949882:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562310.949885:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949891:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562310.949894:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562310.949897:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562310.949911:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562310.949918:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562310.949923:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562310.949936:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949939:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562310.949942:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949947:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b87ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ce9 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.949955:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562310.949956:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562310.949957:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562310.949963:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562310.949979:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588096:0@lo:103: 00000100:00100000:1.0:1783562310.949997:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.950022:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588608:0@lo:103: 00000100:00100000:2.0:1783562310.950029:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588352 00000100:00100000:2.0:1783562310.950033:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588352 00000100:00100000:1.0:1783562310.950043:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783562310.950045:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 18 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.950159:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588480 00000100:00100000:2.0:1783562310.950162:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588480 00000100:00100000:1.0:1783562310.950167:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783562310.950173:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588224:0@lo:103: 00010000:00010000:2.0:1783562310.950174:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 19 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.950184:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588096 00000100:00100000:2.0:1783562310.950186:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588096 00000100:00100000:1.0:1783562310.950193:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.950211:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588736:0@lo:103: 00000100:00100000:1.0:1783562310.950232:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562310.950253:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588608 00010000:00010000:2.0:1783562310.950255:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 20 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950257:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588608 00010000:00010000:1.0:1783562310.950281:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 21 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950294:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588224 00000100:00100000:1.0:1783562310.950297:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588224 00010000:00010000:1.0:1783562310.950306:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 22 pid: 5750 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950315:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588736 00000100:00100000:1.0:1783562310.950317:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588736 00010000:00010000:1.0:1783562310.950325:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 23 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950336:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562310.950342:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+23:3275:x1870200563588352:12345-0@lo:103: 00000100:00100000:2.0:1783562310.950350:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1783562310.950350:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562310.950354:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 23 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.950356:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+23:3275:x1870200563588480:12345-0@lo:103: 00010000:00010000:2.0:1783562310.950363:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562310.950364:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 23 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950367:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 23 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950376:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 23 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.950376:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1499c00/0x4738ba0933b87d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d44 expref: 23 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950385:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d36 expref: 22 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.950385:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562310.950419:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562310.950439:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+21:3275:x1870200563588352:12345-0@lo:103: Request processed in 97us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.950440:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+21:3275:x1870200563588480:12345-0@lo:103: Request processed in 85us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.950446:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562310.950449:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562310.950459:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783562310.950470:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783562310.950475:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563588608:12345-0@lo:103: 00010000:00010000:2.0:1783562310.950483:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562310.950486:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950495:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950504:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d0c expref: 19 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562310.950510:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563588480:0@lo:103: 00010000:00010000:2.0:1783562310.950513:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562310.950518:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563588352:0@lo:103: 00000100:00100000:2.0:1783562310.950536:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3272:x1870200563588608:12345-0@lo:103: Request processed in 61us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.950542:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562310.950554:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3272:x1870200563588096:12345-0@lo:103: 00000100:00100000:2.0:1783562310.950555:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783562310.950560:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3272:x1870200563588224:12345-0@lo:103: 00010000:00010000:1.0:1783562310.950563:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562310.950566:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562310.950568:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 17 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950569:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 17 pid: 5750 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.950577:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 17 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950587:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 17 pid: 5750 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562310.950603:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b87d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d6e expref: 17 pid: 5748 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950605:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87d52 expref: 17 pid: 5750 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.950613:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562310.950613:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562310.950633:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:3272:x1870200563588224:12345-0@lo:103: Request processed in 72us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562310.950633:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:3272:x1870200563588096:12345-0@lo:103: Request processed in 169us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.950639:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562310.950642:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783562310.950650:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783562310.950655:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:3272:x1870200563588736:12345-0@lo:103: 00010000:00010000:2.0:1783562310.950662:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562310.950666:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 13 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950671:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588224:0@lo:103: 00010000:00010000:2.0:1783562310.950674:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 13 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950679:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588096:0@lo:103: 00010000:00010000:2.0:1783562310.950683:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87ce2 expref: 13 pid: 5749 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562310.950685:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588608:0@lo:103: 00010000:00010000:2.0:1783562310.950691:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562310.950716:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:3272:x1870200563588736:12345-0@lo:103: Request processed in 60us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.950722:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783562310.950723:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563588736:0@lo:103: 00000100:00100000:0.0:1783562310.954215:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563586816:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562310.954515:0:8260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8260:1870200563586944:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562310.954568:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562310.954669:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553082880 00000100:00100000:2.0:1783562310.954677:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553082880 00010000:00010000:2.0:1783562310.954714:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 10 pid: 5749 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.954749:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00010000:00010000:0.0:1783562310.954771:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562310.954816:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553082880:12345-192.168.204.4@tcp:103: 00010000:00010000:2.0:1783562310.954831:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562310.954836:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 10 pid: 5749 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.954847:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 10 pid: 5749 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.954864:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b87db4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2108d expref: 10 pid: 5749 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.954878:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562310.954944:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+9:2364:x1870200553082880:12345-192.168.204.4@tcp:103: Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562310.955059:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562310.956666:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562310.956782:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083008 00000100:00100000:0.0:1783562310.956791:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083008 00010000:00010000:0.0:1783562310.956826:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562310.956861:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:0.0:1783562310.956870:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+9:2363:x1870200553083008:12345-192.168.204.4@tcp:103: 00010000:00010000:0.0:1783562310.956882:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562310.956887:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956898:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956930:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21086 expref: 9 pid: 5748 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956946:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956954:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956968:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956974:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956981:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956987:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.956992:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562310.956996:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.957003:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.957020:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562310.957040:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562310.957048:0:8260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.957058:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562310.957065:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87dec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562310.957096:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+8:2363:x1870200553083008:12345-192.168.204.4@tcp:103: Request processed in 226us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562310.957104:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:1.0:1783562311.031810:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563588864:0@lo:400: 00000100:00100000:2.0:1783562311.031828:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563588992:0@lo:400: 00000100:00100000:1.0:1783562311.036114:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.036210:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563589376:0@lo:400: 00000100:00100000:2.0:1783562311.036213:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562311.036319:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588864 00000100:00100000:0.0:1783562311.036331:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588864 00000100:00100000:2.0:1783562311.036344:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563588992 00000100:00100000:2.0:1783562311.036349:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563588992 00000100:00100000:0.0:1783562311.036390:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783562311.036419:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563588864:12345-0@lo:400: 00000100:00100000:2.0:1783562311.036426:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783562311.036436:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563588992:12345-0@lo:400: 00000100:00100000:1.0:1783562311.036623:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.036673:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563589120:0@lo:400: 00000100:00100000:1.0:1783562311.036702:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.036723:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562311.036729:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563589248:0@lo:400: 00000100:00100000:1.0:1783562311.036750:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.036774:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589376 00000100:00100000:1.0:1783562311.036778:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589376 00000100:00100000:1.0:1783562311.036811:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589120 00000100:00100000:1.0:1783562311.036814:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589120 00000100:00100000:1.0:1783562311.036838:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562311.036846:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563589376:12345-0@lo:400: 00000100:00100000:1.0:1783562311.036882:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563589376:12345-0@lo:400: Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.036889:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562311.036904:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562311.036911:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563589120:12345-0@lo:400: 00000100:00100000:1.0:1783562311.036939:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563589120:12345-0@lo:400: Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.036945:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783562311.036984:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6742300 x1870200563589120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562311.037308:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563588864:12345-0@lo:400: Request processed in 906us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562311.037316:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783562311.037334:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589248 00000100:00100000:0.0:1783562311.037339:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589248 00000100:00100000:0.0:1783562311.037361:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783562311.037368:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563589248:12345-0@lo:400: 00000100:00100000:0.0:1783562311.037398:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563589248:12345-0@lo:400: Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562311.037426:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783562311.037748:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563589120:0@lo:400: 00000100:00100000:1.0:1783562311.037782:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563589248:0@lo:400: 00010000:00080000:1.0:1783562311.037902:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6742d80 x1870200563589376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562311.037913:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563589376:0@lo:400: 00000100:00100000:2.0:1783562311.037934:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563588992:12345-0@lo:400: Request processed in 1497us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.037940:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563588864:0@lo:400: 00000100:00100000:2.0:1783562311.037946:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783562311.037976:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783562311.037980:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562311.037983:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562311.038014:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563588992:0@lo:400: 00000100:00100000:3.0:1783562311.542835:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563589504:0@lo:13: 00000100:00100000:3.0:1783562311.542914:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562311.543127:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589504 00000100:00100000:2.0:1783562311.543135:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589504 00000100:00100000:2.0:1783562311.543235:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562311.543246:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563589632:0@lo:13: 00000100:00100000:2.0:1783562311.543249:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563589504:12345-0@lo:13: 00000100:00100000:3.0:1783562311.543295:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783562311.543297:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562311.543357:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563589504:12345-0@lo:13: Request processed in 112us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562311.543365:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783562311.543386:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6743800 x1870200563589504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562311.543505:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563589504:0@lo:13: 00000100:00100000:2.0:1783562311.544673:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589632 00000100:00100000:2.0:1783562311.544685:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589632 00000100:00100000:2.0:1783562311.544722:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562311.544730:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563589632:12345-0@lo:13: 00002000:00000024:2.0:1783562311.544760:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562311.544823:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563589632:12345-0@lo:13: Request processed in 93us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562311.544829:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783562311.544943:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e28e00 x1870200563589632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562311.544962:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563589632:0@lo:13: 00010000:00010000:3.0:1783562311.610183:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783562311.990519:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783562311.990527:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfceec04800 from 39 10000000:01000000:1.0:1783562311.990534:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562311.990735:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562311.990748:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562311.990759:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562311.990787:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563589760:0@lo:101: 00000100:00100000:1.0:1783562311.990865:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.990932:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562311.991172:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589760 00000100:00100000:3.0:1783562311.991180:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589760 00000100:00100000:3.0:1783562311.991231:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783562311.991240:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+12:5752:x1870200563589760:12345-0@lo:101: 00010000:00010000:3.0:1783562311.991264:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562311.991279:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336e00/0x4738ba0933b87dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87df3 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.991302:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336e00/0x4738ba0933b87dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87df3 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.991312:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336e00/0x4738ba0933b87dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87df3 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.991321:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336e00, rc 0) 00000100:00100000:3.0:1783562311.991436:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563589760:12345-0@lo:101: Request processed in 196us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562311.991444:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783562311.991750:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563589760:0@lo:101: 00010000:00010000:1.0:1783562311.991767:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562311.991776:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562311.991832:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563589888:0@lo:501: 00000100:00100000:1.0:1783562311.991860:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.991932:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562311.991971:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563589888 00000100:00100000:3.0:1783562311.991975:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563589888 00000100:00100000:3.0:1783562311.992047:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783562311.992056:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563589888:12345-0@lo:501: 00000100:00100000:3.0:1783562311.992332:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563589888:12345-0@lo:501: Request processed in 277us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562311.992339:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783562311.992398:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563589888:0@lo:501: 00000100:00100000:1.0:1783562311.992673:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590016:0@lo:503: 00000100:00100000:1.0:1783562311.992717:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.992750:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562311.992800:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590016 00000100:00100000:0.0:1783562311.992805:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590016 00000100:00100000:0.0:1783562311.992838:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783562311.992846:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563590016:12345-0@lo:503: 00000100:00100000:0.0:1783562311.993000:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563590016:12345-0@lo:503: Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562311.993007:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783562311.993011:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590016:0@lo:503: 00000100:00100000:1.0:1783562311.993510:0:8276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8276:1870200563590144:0@lo:502: 00000100:00100000:1.0:1783562311.993666:0:8276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.993736:0:8276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562311.993771:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590144 00000100:00100000:3.0:1783562311.993776:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590144 00000100:00100000:3.0:1783562311.993844:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783562311.993852:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:8276:x1870200563590144:12345-0@lo:502: 00000100:00100000:3.0:1783562311.994046:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:8276:x1870200563590144:12345-0@lo:502: Request processed in 195us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562311.994053:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783562311.994135:0:8276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8276:1870200563590144:0@lo:502: 00000100:00100000:2.0:1783562311.994175:0:8276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8276:1870200563590272:0@lo:502: 00000100:00100000:2.0:1783562311.994214:0:8276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562311.994347:0:8276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562311.994391:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590272 00000100:00100000:1.0:1783562311.994396:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590272 00000100:00100000:1.0:1783562311.994539:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783562311.994547:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:8276:x1870200563590272:12345-0@lo:502: 00000100:00100000:1.0:1783562311.994885:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:8276:x1870200563590272:12345-0@lo:502: Request processed in 337us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.994892:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783562311.995008:0:8276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8276:1870200563590272:0@lo:502: 00000040:00080000:2.0:1783562311.995033:0:8276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783562311.996645:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783562311.996700:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783562311.996716:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.996729:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562311.996742:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783562311.996746:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1783562311.996749:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783562311.996810:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.996821:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.996832:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562311.996857:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590400:0@lo:101: 00000100:00100000:3.0:1783562311.996922:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562311.996986:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562311.997563:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590400 00000100:00100000:0.0:1783562311.997571:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590400 00000100:00100000:0.0:1783562311.997629:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783562311.997637:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+13:5752:x1870200563590400:12345-0@lo:101: 00010000:00010000:0.0:1783562311.997659:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562311.997673:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e01 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562311.997697:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e01 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562311.997707:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e01 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562311.997716:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9200, rc 0) 00000100:00100000:0.0:1783562311.997770:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563590400:12345-0@lo:101: Request processed in 134us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562311.997777:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783562311.997929:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590400:0@lo:101: 00010000:00010000:3.0:1783562311.997960:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562311.997968:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562311.998022:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590528:0@lo:501: 00000100:00100000:3.0:1783562311.998050:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562311.998083:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562311.998232:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590528 00000100:00100000:1.0:1783562311.998237:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590528 00000100:00100000:1.0:1783562311.998280:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783562311.998288:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563590528:12345-0@lo:501: 00000100:00100000:1.0:1783562311.998573:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563590528:12345-0@lo:501: Request processed in 286us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.998581:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783562311.998824:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590528:0@lo:501: 00000100:00100000:2.0:1783562311.998876:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590656:0@lo:503: 00000100:00100000:2.0:1783562311.998937:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562311.998988:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590656 00000100:00100000:1.0:1783562311.998993:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590656 00000100:00100000:2.0:1783562311.999016:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562311.999068:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783562311.999077:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563590656:12345-0@lo:503: 00000100:00100000:1.0:1783562311.999217:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563590656:12345-0@lo:503: Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562311.999233:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783562311.999827:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563590656:0@lo:503: 00000100:00100000:1.0:1783562312.000268:0:8277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8277:1870200563590784:0@lo:502: 00000100:00100000:1.0:1783562312.000310:0:8277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.000377:0:8277:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.000558:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590784 00000100:00100000:3.0:1783562312.000564:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590784 00000100:00100000:3.0:1783562312.000644:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783562312.000662:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:8277:x1870200563590784:12345-0@lo:502: 00000100:00100000:3.0:1783562312.000849:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:8277:x1870200563590784:12345-0@lo:502: Request processed in 197us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562312.000856:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783562312.000937:0:8277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8277:1870200563590784:0@lo:502: 00000020:01000000:1.0:1783562312.000960:0:8277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562312.000969:0:8277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562312.000972:0:8277:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783562312.000982:0:8277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783562312.001003:0:8277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8277:1870200563590912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562312.001038:0:8277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.001318:0:8277:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.001380:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563590912 00000100:00100000:0.0:1783562312.001385:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563590912 00000100:00100000:0.0:1783562312.001433:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783562312.001440:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:8277:x1870200563590912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.001570:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:8277:x1870200563590912:12345-0@lo:502:llog_process_th.0 Request processed in 130us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.001576:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783562312.001699:0:8277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8277:1870200563590912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562312.001719:0:8277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562312.001724:0:8277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562312.001726:0:8277:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783562312.001732:0:8277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783562312.001940:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1783562312.001957:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783562312.001968:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.001978:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562312.001987:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783562312.001989:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc7fb7800 from 39 10000000:01000000:3.0:1783562312.001992:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562312.002017:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.002031:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.002040:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562312.002055:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.002100:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562312.002127:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.002233:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591040 00000100:00100000:0.0:1783562312.002237:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591040 00000100:00100000:0.0:1783562312.002277:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783562312.002284:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:5752:x1870200563591040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562312.002292:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562312.002304:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8c00/0x4738ba0933b87e16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e0f expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.002323:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8c00/0x4738ba0933b87e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e0f expref: 15 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.002332:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8c00/0x4738ba0933b87e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e0f expref: 15 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.002340:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8c00, rc 0) 00000100:00100000:0.0:1783562312.002379:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.002384:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783562312.002509:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562312.002521:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.002529:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.002573:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.002597:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.002630:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.002719:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591168 00000100:00100000:3.0:1783562312.002723:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591168 00000100:00100000:3.0:1783562312.002754:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783562312.002761:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.003191:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 429us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562312.003198:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783562312.003263:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.003290:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.003327:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.003392:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.003502:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591296 00000100:00100000:2.0:1783562312.003508:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591296 00000100:00100000:0.0:1783562312.003586:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783562312.003595:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562312.003871:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.003876:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783562312.003938:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.004325:0:8278:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8278:1870200563591424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.004367:0:8278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.004443:0:8278:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.004559:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591424 00000100:00100000:3.0:1783562312.004564:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591424 00000100:00100000:3.0:1783562312.004602:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783562312.004610:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:8278:x1870200563591424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562312.004899:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:8278:x1870200563591424:12345-0@lo:502:llog_process_th.0 Request processed in 289us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562312.004906:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783562312.004988:0:8278:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8278:1870200563591424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.005026:0:8278:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8278:1870200563591552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.005049:0:8278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.005110:0:8278:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.005240:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591552 00000100:00100000:0.0:1783562312.005244:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591552 00000100:00100000:0.0:1783562312.005308:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783562312.005314:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:8278:x1870200563591552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.005447:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:8278:x1870200563591552:12345-0@lo:502:llog_process_th.0 Request processed in 133us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.005460:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783562312.005530:0:8278:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8278:1870200563591552:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783562312.005551:0:8278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783562312.005618:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783562312.005635:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562312.005644:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.005655:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562312.005663:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783562312.005666:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1783562312.005669:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783562312.005691:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.005699:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.005707:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.005721:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.005820:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.006746:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591680 00000100:00100000:2.0:1783562312.006756:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591680 00000100:00100000:2.0:1783562312.006816:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783562312.006826:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+15:5752:x1870200563591680:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.006881:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783562312.007004:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562312.007023:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e1d expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.007064:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e1d expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.007075:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e1d expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.007085:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:2.0:1783562312.007143:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563591680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.007150:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783562312.007235:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562312.007333:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.007344:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.007524:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.007560:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.007577:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.007632:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591808 00000100:00100000:0.0:1783562312.007637:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591808 00000100:00100000:0.0:1783562312.007674:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783562312.007681:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563591808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562312.008210:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563591808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.008219:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783562312.008361:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.008397:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.008477:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.008496:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.008617:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563591936 00000100:00100000:2.0:1783562312.008622:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563591936 00000100:00100000:2.0:1783562312.008657:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783562312.008665:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563591936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.008817:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563591936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.008824:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783562312.009077:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563591936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.009555:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8279:1870200563592064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562312.009604:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562312.009629:0:8279:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.009690:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592064 00000100:00100000:0.0:1783562312.009696:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592064 00000100:00100000:0.0:1783562312.009768:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783562312.009777:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:8279:x1870200563592064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.009957:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:8279:x1870200563592064:12345-0@lo:502:llog_process_th.0 Request processed in 180us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.009964:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783562312.010052:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8279:1870200563592064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562312.010077:0:8279:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562312.010087:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562312.010090:0:8279:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783562312.010101:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783562312.010121:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8279:1870200563592192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562312.010157:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.013355:0:8279:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.013362:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592192 00000100:00100000:3.0:1783562312.013372:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592192 00000100:00100000:3.0:1783562312.013658:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783562312.013667:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:8279:x1870200563592192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562312.013894:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:8279:x1870200563592192:12345-0@lo:502:llog_process_th.0 Request processed in 228us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562312.013900:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783562312.013944:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8279:1870200563592192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562312.013983:0:8279:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562312.013991:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562312.013994:0:8279:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783562312.014004:0:8279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1783562312.014083:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783562312.014191:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783562312.014200:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.014208:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562312.014215:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783562312.014217:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc78df800 from 39 10000000:01000000:3.0:1783562312.014219:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562312.014242:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.014259:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562312.014266:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562312.014289:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.014316:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562312.014364:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.014387:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592320 00000100:00100000:0.0:1783562312.014397:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592320 00000100:00100000:0.0:1783562312.014553:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783562312.014559:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563592320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562312.014566:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562312.014576:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b87e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e2b expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.014592:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b87e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e2b expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.014599:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b87e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e2b expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.014663:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8600, rc 0) 00000100:00100000:0.0:1783562312.014690:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.014694:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783562312.014722:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562312.014747:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.014757:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.014802:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.014829:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.014860:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.015168:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592448 00000100:00100000:2.0:1783562312.015173:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592448 00000100:00100000:2.0:1783562312.015199:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783562312.015206:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.015864:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 656us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.015873:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783562312.015987:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.016084:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.016128:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.016190:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.016219:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592576 00000100:00100000:0.0:1783562312.016224:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592576 00000100:00100000:0.0:1783562312.016297:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783562312.016306:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562312.016873:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 566us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.016881:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783562312.017077:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.017712:0:8280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8280:1870200563592704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562312.017776:0:8280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.017816:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592704 00000100:00100000:3.0:1783562312.017819:0:8280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.017823:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592704 00000100:00100000:2.0:1783562312.017866:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783562312.017874:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8280:x1870200563592704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.018080:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8280:x1870200563592704:12345-0@lo:502:llog_process_th.0 Request processed in 205us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.018087:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783562312.018178:0:8280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8280:1870200563592704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.018212:0:8280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8280:1870200563592832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.018259:0:8280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.018307:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592832 00000100:00100000:2.0:1783562312.018311:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592832 00000100:00100000:2.0:1783562312.018343:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783562312.018350:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8280:x1870200563592832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.018388:0:8280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.018625:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8280:x1870200563592832:12345-0@lo:502:llog_process_th.0 Request processed in 274us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.018632:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783562312.018656:0:8280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8280:1870200563592832:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783562312.018675:0:8280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783562312.018838:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783562312.018856:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562312.018868:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.018879:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562312.018899:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783562312.018902:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783562312.018904:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783562312.018927:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.018935:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.018941:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.018952:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.018973:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.018995:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.019006:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563592960 00000100:00100000:2.0:1783562312.019010:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563592960 00000100:00100000:2.0:1783562312.019041:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783562312.019047:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563592960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562312.019056:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562312.019067:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87e40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e39 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.019086:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e39 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.019096:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e39 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562312.019104:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2200, rc 0) 00000100:00100000:2.0:1783562312.019144:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563592960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.019155:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783562312.019204:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563592960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562312.019215:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.019224:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.019274:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.019298:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.019346:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.019375:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593088 00000100:00100000:2.0:1783562312.019379:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593088 00000100:00100000:2.0:1783562312.019565:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783562312.019577:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563593088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.019807:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563593088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562312.019828:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.019856:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.019893:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783562312.019904:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.019922:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593216 00000100:00100000:2.0:1783562312.019926:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593216 00000100:00100000:1.0:1783562312.019929:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562312.019992:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783562312.020000:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563593216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562312.020135:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563593216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562312.020141:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783562312.020193:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.020360:0:8281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8281:1870200563593344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562312.020392:0:8281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.020628:0:8281:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.020659:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593344 00000100:00100000:0.0:1783562312.020664:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593344 00000100:00100000:0.0:1783562312.020695:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783562312.020702:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8281:x1870200563593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562312.020907:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8281:x1870200563593344:12345-0@lo:502:llog_process_th.0 Request processed in 204us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.020914:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783562312.020925:0:8281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8281:1870200563593344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562312.020946:0:8281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562312.020955:0:8281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562312.020957:0:8281:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783562312.020964:0:8281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783562312.020988:0:8281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8281:1870200563593472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.021020:0:8281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562312.021044:0:8281:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.021084:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593472 00000100:00100000:3.0:1783562312.021088:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593472 00000100:00100000:3.0:1783562312.021145:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783562312.021152:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8281:x1870200563593472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562312.021389:0:8281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8281:1870200563593472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562312.021391:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8281:x1870200563593472:12345-0@lo:502:llog_process_th.0 Request processed in 239us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562312.021397:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000020:01000000:2.0:1783562312.021605:0:8281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562312.021615:0:8281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562312.021616:0:8281:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783562312.021621:0:8281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783562312.021694:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1783562312.021715:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783562312.021756:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.021828:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562312.021836:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783562312.021839:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfcc3f199c0 from 1 10000000:01000000:1.0:1783562312.021842:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783562312.021865:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.021881:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.021895:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.021909:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.021942:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.021974:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562312.021979:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593600 00000100:00100000:0.0:1783562312.021986:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593600 00000100:00100000:0.0:1783562312.022023:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783562312.022030:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563593600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562312.022038:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562312.022051:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9000/0x4738ba0933b87e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e47 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.022076:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9000/0x4738ba0933b87e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e47 expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.022088:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb9000/0x4738ba0933b87e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e47 expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562312.022098:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9000, rc 0) 00000100:00100000:0.0:1783562312.022135:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563593600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562312.022142:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783562312.022174:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562312.022187:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.022195:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562312.022233:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562312.022271:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562312.022451:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562312.022548:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593728 00000100:00100000:3.0:1783562312.022554:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593728 00000100:00100000:3.0:1783562312.022584:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783562312.022591:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563593728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562312.022886:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563593728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (613us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783562312.022893:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783562312.022929:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563593728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783562312.022952:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783562312.022959:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.022968:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562312.631468:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562313.655164:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562313.792487:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.795310:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083136 00000100:00100000:3.0:1783562313.795331:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083136 00000100:00100000:3.0:1783562313.795437:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 155 00000100:00100000:3.0:1783562313.795452:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+8:5573:x1870200553083136:12345-192.168.204.4@tcp:101: 00010000:00010000:3.0:1783562313.795474:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562313.795515:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87e55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210ef expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.795555:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210ef expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.795570:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210ef expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.795582:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337000, rc 0) 00000100:00100000:3.0:1783562313.795667:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083136:12345-192.168.204.4@tcp:101: Request processed in 218us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.795676:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 155 00000100:00100000:1.0:1783562313.798962:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.799045:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083264 00000100:00100000:3.0:1783562313.799060:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083264 00000100:00100000:3.0:1783562313.799122:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 156 00000100:00100000:3.0:1783562313.799134:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083264:12345-192.168.204.4@tcp:501: 00000100:00100000:3.0:1783562313.799651:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083264:12345-192.168.204.4@tcp:501: Request processed in 520us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.799658:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 156 00000100:00100000:2.0:1783562313.805541:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.805673:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083392 00000100:00100000:3.0:1783562313.805686:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083392 00000100:00100000:3.0:1783562313.805798:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 157 00000100:00100000:3.0:1783562313.805812:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083392:12345-192.168.204.4@tcp:503: 00000100:00100000:3.0:1783562313.806163:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083392:12345-192.168.204.4@tcp:503: Request processed in 351us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.806174:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 157 00000100:00100000:0.0:1783562313.810615:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.811045:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083520 00000100:00100000:3.0:1783562313.811079:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083520 00000100:00100000:3.0:1783562313.811342:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 158 00000100:00100000:3.0:1783562313.811355:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:6054:x1870200553083520:12345-192.168.204.4@tcp:502: 00000100:00100000:3.0:1783562313.811787:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:6054:x1870200553083520:12345-192.168.204.4@tcp:502: Request processed in 435us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.811840:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 158 00000100:00100000:1.0:1783562313.815047:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.815364:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083648 00000100:00100000:3.0:1783562313.815379:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083648 00000100:00100000:3.0:1783562313.815497:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 159 00000100:00100000:3.0:1783562313.815509:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:6054:x1870200553083648:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783562313.816349:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+9:6054:x1870200553083648:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 836us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.816362:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 159 00000100:00100000:2.0:1783562313.820002:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.820339:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083776 00000100:00100000:3.0:1783562313.820354:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083776 00000100:00100000:3.0:1783562313.820514:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 160 00000100:00100000:3.0:1783562313.820528:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553083776:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562313.820551:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562313.820575:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87e5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210f6 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.820613:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210f6 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.820626:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210f6 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562313.820671:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337600, rc 0) 00000100:00100000:3.0:1783562313.820755:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553083776:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 230us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562313.820763:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 160 00000100:00100000:0.0:1783562313.827224:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562313.827336:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553083904 00000100:00100000:3.0:1783562313.827350:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553083904 00000100:00100000:3.0:1783562313.827485:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 161 00000100:00100000:3.0:1783562313.827502:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553083904:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562313.827964:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553083904:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 466us (768us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783562313.827975:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 161 00010000:00010000:1.0:1783562314.678565:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783562314.705743:0:8321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd687e2dc0 20000000:00000080:0.0:1783562314.705769:0:8321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcef11a400 uarg=0000000000000000 20000000:01000000:0.0:1783562314.705819:0:8321:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783562314.705825:0:8321:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783562314.705832:0:8321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783562314.707035:0:8322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1783562314.707256:0:8321:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1783562314.715041:0:8321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1783562314.715100:0:8321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1783562314.715184:0:8321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1783562314.715233:0:8321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783562314.715253:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715272:0:8321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715281:0:8321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715288:0:8321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715299:0:8321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715308:0:8321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715348:0:8321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715363:0:8321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 9 pid: 5750 timeout: 223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.715378:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563593856:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562314.715526:0:8321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715535:0:8321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 18 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.715559:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563593984:0@lo:104: 00000100:00100000:0.0:1783562314.715603:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562314.715642:0:8321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715653:0:8321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 18 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.715668:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563594112:0@lo:104: 00000100:00100000:1.0:1783562314.715677:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563593984 00000100:00100000:1.0:1783562314.715691:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563593984 00000100:00100000:0.0:1783562314.715696:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562314.715741:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594112 00000100:00100000:0.0:1783562314.715749:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594112 00000100:00100000:1.0:1783562314.715766:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783562314.715782:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8321:x1870200563593984:12345-0@lo:104: 00010000:00010000:0.0:1783562314.715812:0:8321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.715817:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.715827:0:8321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 18 pid: 5750 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.715842:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563594240:0@lo:104: 00000100:00100000:0.0:1783562314.715900:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783562314.715928:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783562314.715939:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8321:x1870200563593984:12345-0@lo:104: Request processed in 161us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562314.715940:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c14780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562314.715958:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783562314.715972:0:5737:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783562314.715979:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563593984:0@lo:104: 00000100:00100000:1.0:1783562314.715992:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594240 00000100:00100000:1.0:1783562314.715999:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594240 00000100:00100000:1.0:1783562314.716023:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562314.716030:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8321:x1870200563594112:12345-0@lo:104: 00010000:00010000:1.0:1783562314.716039:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716097:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783562314.716104:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:8321:x1870200563594112:12345-0@lo:104: Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562314.716111:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562314.716130:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783562314.716137:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf671a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:8321:x1870200563594240:12345-0@lo:104: 00010000:00010000:1.0:1783562314.716146:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716206:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783562314.716214:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563594112:0@lo:104: 00000100:00100000:1.0:1783562314.716216:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf671a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:8321:x1870200563594240:12345-0@lo:104: Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562314.716235:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783562314.716248:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563594240:0@lo:104: 00010000:00010000:3.0:1783562314.716267:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562314.716280:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.716290:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3000 already unused, calling callback (ffffffffc1a65c20) 00010000:00010000:1.0:1783562314.716293:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1783562314.716295:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.716309:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716310:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716343:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562314.716348:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562314.716366:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716370:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562314.716387:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1783562314.716392:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562314.716399:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783562314.716482:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.716485:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562314.716488:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716510:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562314.716515:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562314.716549:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.716552:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.716560:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563594368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562314.716570:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfd020c9400/0x4738ba0933b87ca3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87caa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562314.716594:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562314.716597:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562314.716600:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562314.716616:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562314.716680:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563594496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562314.716686:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b87cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87d05 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.716705:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562314.716709:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562314.716713:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562314.716733:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562314.716848:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594368 00000100:00100000:3.0:1783562314.716855:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594368 00010000:00010000:3.0:1783562314.716881:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 19 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562314.716912:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594496 00000100:00100000:3.0:1783562314.716916:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594496 00010000:00010000:3.0:1783562314.716929:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562314.716942:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783562314.716953:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3273:x1870200563594368:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562314.716965:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783562314.716967:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562314.716976:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562314.716977:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3274:x1870200563594496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562314.716990:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562314.716993:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.716996:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.717013:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.717180:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b87caa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87ca3 expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.717182:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87d05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87cfe expref: 20 pid: 5749 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.717208:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562314.717215:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562314.717274:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3273:x1870200563594368:12345-0@lo:103:ldlm_bl.0 Request processed in 322us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562314.717279:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3274:x1870200563594496:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562314.717288:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783562314.717298:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783562314.717313:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563594496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562314.717348:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563594368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562314.718118:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562314.718122:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562314.718124:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562314.718148:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.718160:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562314.718165:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.718175:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562314.718183:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562314.718215:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783562314.718258:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.718267:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562314.718293:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.718299:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031200/0x4738ba0933b87c25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87c2c expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562314.718314:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783562314.718318:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562314.718322:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562314.718324:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562314.718334:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563594624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562314.718399:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562314.718539:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594624 00000100:00100000:3.0:1783562314.718546:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594624 00010000:00010000:3.0:1783562314.718577:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 17 pid: 5750 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562314.718644:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783562314.718655:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3274:x1870200563594624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562314.718668:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562314.718673:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 17 pid: 5750 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.718683:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 17 pid: 5750 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.718698:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b87c2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87c25 expref: 17 pid: 5750 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.718717:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562314.718759:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563594624:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562314.718767:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783562314.718844:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563594624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562314.720105:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8321:1870200563593856:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562314.720145:0:8321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562314.721248:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562314.721345:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084032 00000100:00100000:3.0:1783562314.721357:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084032 00010000:00010000:3.0:1783562314.721650:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562314.721742:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:3.0:1783562314.721754:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+10:2363:x1870200553084032:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562314.721774:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562314.721781:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721795:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721816:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87dc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210be expref: 10 pid: 5750 timeout: 223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721834:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721843:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721862:0:7447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721869:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721884:0:7447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721891:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721897:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562314.721903:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721913:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721938:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562314.721951:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562314.722026:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+9:2363:x1870200553084032:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 274us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562314.722035:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00010000:00010000:0.0:1783562314.722151:0:8321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.722161:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562314.722168:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b87e63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562315.199697:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562315.199736:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562315.199764:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562315.199780:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084160 00000100:00100000:2.0:1783562315.199794:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084160 00000100:00100000:1.0:1783562315.199903:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084288 00000100:00100000:1.0:1783562315.199908:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084288 00000100:00100000:1.0:1783562315.199977:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084416 00000100:00100000:1.0:1783562315.199981:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084416 00000100:00100000:1.0:1783562315.200003:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562315.200013:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553084288:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562315.200087:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553084288:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562315.200095:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562315.200113:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562315.200125:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553084416:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562315.200150:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553084416:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562315.200157:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00080000:2.0:1783562315.200891:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562315.200896:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562315.200952:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562315.200961:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553084160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562315.200999:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553084160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562315.201006:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00080000:2.0:1783562315.201051:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783562315.703131:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562315.775323:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562315.776332:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084544 00000100:00100000:2.0:1783562315.776351:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084544 00000100:00100000:2.0:1783562315.776785:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 162 00000100:00100000:2.0:1783562315.776813:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+9:5573:x1870200553084544:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562315.776840:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562315.776867:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c210fd expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562315.776906:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562315.776919:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562315.776932:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3000, rc 0) 00000100:00100000:2.0:1783562315.777063:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553084544:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 253us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562315.777072:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 162 00000100:00100000:2.0:1783562315.782454:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562315.782601:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084672 00000100:00100000:0.0:1783562315.782617:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084672 00000100:00100000:0.0:1783562315.782696:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 163 00000100:00100000:0.0:1783562315.782710:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553084672:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562315.783514:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553084672:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 804us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562315.783536:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 163 00000100:00100000:1.0:1783562315.790684:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562315.791649:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084800 00000100:00100000:1.0:1783562315.791668:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084800 00000100:00100000:1.0:1783562315.794161:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 164 00000100:00100000:1.0:1783562315.794197:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553084800:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562315.794863:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:5573:x1870200553084800:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 681us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562315.794875:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 164 00000100:00100000:3.0:1783562315.803588:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562315.803681:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553084928 00000100:00100000:0.0:1783562315.803697:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553084928 00000100:00100000:0.0:1783562315.803780:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 165 00000100:00100000:0.0:1783562315.803793:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:6117:x1870200553084928:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562315.804102:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:6117:x1870200553084928:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 311us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562315.804110:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 165 00000100:00100000:0.0:1783562315.807661:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562315.807947:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085056 00000100:00100000:1.0:1783562315.807966:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085056 00000100:00100000:1.0:1783562315.808041:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 166 00000100:00100000:1.0:1783562315.808064:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:6117:x1870200553085056:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783562315.808505:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:6117:x1870200553085056:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 442us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562315.808515:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 166 00000100:00100000:3.0:1783562316.152523:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563594752:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152599:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152648:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563595264:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152684:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152711:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783562316.152718:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563594880:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152743:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152758:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563595392:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152780:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152805:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563595008:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152842:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152859:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562316.152864:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563595136:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.152881:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.152907:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594752 00000100:00100000:3.0:1783562316.152914:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594752 00000100:00100000:3.0:1783562316.152951:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783562316.152958:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3272:x1870200563594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.153007:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3272:x1870200563594752:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.153015:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783562316.153053:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595264 00000100:00100000:3.0:1783562316.153057:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595264 00000100:00080000:0.0:1783562316.153098:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562316.153100:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563594880 00000100:00100000:3.0:1783562316.153105:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563594880 00000100:00100000:3.0:1783562316.153118:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595008 00000100:00100000:3.0:1783562316.153120:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595008 00000100:00100000:3.0:1783562316.153145:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783562316.153151:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.153195:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563595264:12345-0@lo:400:kworker.0 Request processed in 43us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.153207:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783562316.153220:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783562316.153227:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563594880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.153253:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563594880:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.153259:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1783562316.153311:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562316.154419:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783562316.154432:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563595008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.154501:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563595008:12345-0@lo:400:kworker.0 Request processed in 74us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.154508:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783562316.154537:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595392 00000100:00100000:3.0:1783562316.154543:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595392 00000100:00100000:3.0:1783562316.154581:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595136 00000100:00100000:3.0:1783562316.154584:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595136 00000100:00100000:3.0:1783562316.154606:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783562316.154613:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.154649:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563595392:12345-0@lo:400:kworker.0 Request processed in 38us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.154656:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783562316.154666:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562316.154673:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563595136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.154701:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563595136:12345-0@lo:400:kworker.0 Request processed in 29us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.154707:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562316.154775:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563594880:0@lo:400:kworker.0 00010000:00080000:3.0:1783562316.154791:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69b100 x1870200563595392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562316.154802:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563595392:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.154813:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563594752:0@lo:400:kworker.0 00000100:00100000:3.0:1783562316.154823:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563595264:0@lo:400:kworker.0 00000100:00080000:0.0:1783562316.155392:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783562316.155399:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783562316.155494:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef69a300 x1870200563595136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562316.155508:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef69a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563595136:0@lo:400:kworker.0 00000100:00100000:1.0:1783562316.155521:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563595008:0@lo:400:kworker.0 10000000:01000000:2.0:1783562316.535040:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783562316.535048:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfceec04800 from 4 10000000:01000000:2.0:1783562316.535053:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562316.535102:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.535112:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.535121:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562316.535142:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.535244:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.535363:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.535439:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595520 00000100:00100000:0.0:1783562316.535447:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595520 00000100:00100000:0.0:1783562316.535498:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783562316.535522:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563595520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562316.535536:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562316.535550:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e71 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.535575:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.535587:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.535596:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562316.535657:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563595520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.535665:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783562316.535793:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562316.535820:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.535830:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562316.535885:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.535910:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.535940:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562316.536006:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595648 00000100:00100000:1.0:1783562316.536010:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595648 00000100:00100000:1.0:1783562316.536043:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783562316.536050:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563595648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562316.536348:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563595648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562316.536356:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783562316.538709:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.538778:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.538919:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.538963:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.539052:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595776 00000100:00100000:0.0:1783562316.539060:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595776 00000100:00100000:0.0:1783562316.539109:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783562316.539117:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563595776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.539310:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563595776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.539318:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783562316.539431:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563595776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.540490:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8431:1870200563595904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562316.540565:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.540938:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562316.540991:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563595904 00000100:00100000:1.0:1783562316.540998:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563595904 00000100:00100000:1.0:1783562316.541113:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783562316.541123:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8431:x1870200563595904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562316.541447:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8431:x1870200563595904:12345-0@lo:502:llog_process_th.0 Request processed in 324us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562316.541457:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783562316.542063:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8431:1870200563595904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562316.542105:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562316.542115:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562316.542117:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783562316.542126:0:8431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfceec04800 00000020:00000080:0.0:1783562316.542128:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783562316.542261:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8431:1870200563596032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562316.542321:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562316.542698:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596032 00000100:00100000:1.0:1783562316.542705:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596032 00000100:00100000:0.0:1783562316.542733:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562316.542750:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783562316.542770:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8431:x1870200563596032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562316.542956:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:8431:x1870200563596032:12345-0@lo:502:llog_process_th.0 Request processed in 188us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562316.542964:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783562316.544815:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8431:1870200563596032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562316.544851:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562316.544859:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562316.544860:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783562316.544866:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783562316.544992:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783562316.545009:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562316.545019:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545030:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562316.545041:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783562316.545043:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc7fb7800 from 4 10000000:01000000:0.0:1783562316.545046:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562316.545074:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545082:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545091:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562316.545109:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.545180:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.545211:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.545227:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596160 00000100:00100000:0.0:1783562316.545233:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596160 00000100:00100000:0.0:1783562316.545275:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783562316.545285:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563596160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562316.545298:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562316.545312:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e7f expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545347:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545357:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.545366:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9400, rc 0) 00000100:00100000:0.0:1783562316.545425:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.545434:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783562316.545442:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562316.545457:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562316.545467:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562316.545512:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562316.545541:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.545579:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.546778:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596288 00000100:00100000:0.0:1783562316.546786:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596288 00000100:00100000:0.0:1783562316.546835:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783562316.546845:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.547135:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.547146:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783562316.547175:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.547224:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.547273:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.547321:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.548238:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596416 00000100:00100000:0.0:1783562316.548247:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596416 00000100:00100000:0.0:1783562316.548354:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783562316.548364:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.548602:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.548610:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783562316.550081:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.550834:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8433:1870200563596544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562316.550921:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.550967:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562316.551152:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596544 00000100:00100000:3.0:1783562316.551159:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596544 00000100:00100000:3.0:1783562316.551216:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783562316.551231:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8433:x1870200563596544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562316.551599:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8433:x1870200563596544:12345-0@lo:502:llog_process_th.0 Request processed in 369us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.551606:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783562316.551742:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8433:1870200563596544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562316.551769:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562316.551779:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562316.551781:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783562316.551790:0:8433:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc7fb7800 00000020:00000080:2.0:1783562316.551793:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783562316.551907:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8433:1870200563596672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562316.551952:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.551990:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562316.552069:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596672 00000100:00100000:3.0:1783562316.552088:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596672 00000100:00100000:3.0:1783562316.552183:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783562316.552194:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8433:x1870200563596672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562316.552472:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:8433:x1870200563596672:12345-0@lo:502:llog_process_th.0 Request processed in 279us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.552486:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783562316.553233:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8433:1870200563596672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562316.553273:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562316.553282:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562316.553285:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783562316.553290:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783562316.553612:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783562316.553651:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783562316.553666:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.553680:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562316.553693:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783562316.553697:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc78df800 from 4 10000000:01000000:2.0:1783562316.553700:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562316.553738:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.553748:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562316.553760:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562316.553795:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562316.553852:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562316.553905:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562316.554111:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596800 00000100:00100000:3.0:1783562316.554118:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596800 00000100:00100000:3.0:1783562316.554177:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783562316.554190:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563596800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562316.554203:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562316.554220:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87e8d expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562316.554248:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562316.554262:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562316.554272:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336c00, rc 0) 00000100:00100000:3.0:1783562316.554343:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563596800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.554352:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783562316.554378:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562316.554453:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.554464:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562316.554518:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.554546:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.554560:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562316.554691:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563596928 00000100:00100000:3.0:1783562316.554696:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563596928 00000100:00100000:3.0:1783562316.554730:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783562316.554737:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563596928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562316.554975:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563596928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.554982:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783562316.555064:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563596928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.555098:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563597056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.555339:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.555456:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.555470:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597056 00000100:00100000:0.0:1783562316.555474:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597056 00000100:00100000:0.0:1783562316.555498:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783562316.555504:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563597056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.555644:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563597056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.555651:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783562316.555685:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563597056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562316.555848:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8435:1870200563597184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562316.555883:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.555901:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597184 00000100:00100000:0.0:1783562316.555906:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597184 00000100:00100000:0.0:1783562316.555930:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783562316.555936:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:8435:x1870200563597184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562316.556057:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:8435:x1870200563597184:12345-0@lo:502:llog_process_th.0 Request processed in 121us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.556064:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783562316.556096:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.556108:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8435:1870200563597184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562316.556142:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562316.556151:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562316.556154:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783562316.556172:0:8435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc78df800 00000020:00000080:0.0:1783562316.556174:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783562316.558170:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8435:1870200563597312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562316.558245:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.558286:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562316.558307:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597312 00000100:00100000:0.0:1783562316.558314:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597312 00000100:00100000:0.0:1783562316.558420:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783562316.558431:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:8435:x1870200563597312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562316.558649:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:8435:x1870200563597312:12345-0@lo:502:llog_process_th.0 Request processed in 219us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.558657:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783562316.558773:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:8435:1870200563597312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783562316.558801:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562316.558808:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562316.558810:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783562316.558816:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783562316.559236:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783562316.559369:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562316.559381:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562316.559394:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562316.663185:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563597440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562316.663271:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562316.663369:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597440 00000100:00100000:0.0:1783562316.663389:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597440 00000100:00100000:0.0:1783562316.663454:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783562316.663463:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563597440:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562316.663555:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563597568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562316.663587:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562316.663633:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597568 00000100:00100000:3.0:1783562316.663637:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597568 00000100:00100000:3.0:1783562316.663658:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562316.663664:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563597568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562316.663688:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562316.663730:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563597568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562316.663737:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783562316.663777:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6741180 x1870200563597568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562316.663796:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563597568:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783562316.664546:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562316.666119:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563597440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2647us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562316.666133:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783562316.669241:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e2b480 x1870200563597440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562316.669275:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563597440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783562316.726923:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562317.750551:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562318.681187:0:8619:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1783562318.778738:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562319.798532:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562320.316510:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562320.316545:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562320.316583:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562320.316602:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562320.316634:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085568 00000100:00100000:3.0:1783562320.316645:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085568 00000100:00100000:3.0:1783562320.316714:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085440 00000100:00100000:3.0:1783562320.316717:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085440 00000100:00100000:3.0:1783562320.316739:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562320.316750:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553085568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562320.316831:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553085568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562320.316838:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562320.316857:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:3.0:1783562320.316863:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553085440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562320.316886:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553085440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562320.316892:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:0.0:1783562320.317109:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085312 00000100:00100000:0.0:1783562320.317115:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085312 00000100:00100000:0.0:1783562320.317161:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00080000:1.0:1783562320.317168:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562320.317170:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553085312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1783562320.317175:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562320.317177:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562320.317186:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085184 00000100:00100000:1.0:1783562320.317191:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085184 00000100:00100000:0.0:1783562320.317204:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553085312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562320.317210:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1783562320.317218:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 183 00000100:00100000:1.0:1783562320.317225:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:2362:x1870200553085184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562320.317251:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:2362:x1870200553085184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562320.317257:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 183 00010000:00010000:3.0:1783562320.823909:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562321.270574:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563597696:0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.270626:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563597824:0@lo:400:kworker.0 00000100:00100000:3.0:1783562321.270716:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562321.270716:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562321.270790:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563598208:0@lo:400:kworker.0 00000100:00100000:2.0:1783562321.270816:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597696 00000100:00100000:2.0:1783562321.270834:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597696 00000100:00100000:1.0:1783562321.270910:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563598336:0@lo:400:kworker.0 00000100:00100000:2.0:1783562321.270919:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783562321.270938:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563597696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.270966:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562321.271026:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563597952:0@lo:400:kworker.0 00000100:00100000:2.0:1783562321.271047:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563597696:12345-0@lo:400:kworker.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562321.271058:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783562321.271086:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563598080:0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.271115:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562321.271153:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598336 00000100:00100000:1.0:1783562321.271162:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598336 00000100:00100000:1.0:1783562321.271218:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598080 00000100:00100000:1.0:1783562321.271222:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598080 00000100:00100000:1.0:1783562321.271249:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562321.271258:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563598336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.271317:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563598336:12345-0@lo:400:kworker.0 Request processed in 59us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562321.271325:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562321.271343:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562321.271349:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563598080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.271381:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563598080:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562321.271387:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783562321.271430:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562321.271436:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783562321.271470:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7122680 x1870200563598080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562321.271485:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563598080:0@lo:400:kworker.0 00010000:00080000:1.0:1783562321.271526:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf7120a80 x1870200563598336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562321.271534:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563598336:0@lo:400:kworker.0 00000100:00100000:2.0:1783562321.271719:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597824 00000100:00100000:2.0:1783562321.271729:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597824 00000100:00100000:2.0:1783562321.271780:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783562321.271789:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563597824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562321.271850:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563597824:12345-0@lo:400:kworker.0 Request processed in 63us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562321.271857:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783562321.271914:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563597824:0@lo:400:kworker.0 00000100:00100000:3.0:1783562321.272146:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562321.272229:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563597696:0@lo:400:kworker.0 00000100:00100000:3.0:1783562321.272265:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562321.272314:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598208 00000100:00100000:3.0:1783562321.272320:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598208 00000100:00100000:3.0:1783562321.272555:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563597952 00000100:00100000:3.0:1783562321.272560:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563597952 00000100:00100000:3.0:1783562321.272592:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562321.272600:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563598208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562321.272631:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562321.272644:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563597952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562321.272657:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563598208:12345-0@lo:400:kworker.0 Request processed in 56us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562321.272665:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783562321.272694:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562321.272696:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563597952:12345-0@lo:400:kworker.0 Request processed in 56us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562321.272706:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783562321.272719:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563597952:0@lo:400:kworker.0 00000100:00100000:3.0:1783562321.272749:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563598208:0@lo:400:kworker.0 00000001:02000400:2.0:1783562321.765629:0:8865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing yml_node 00000100:00100000:2.0:1783562321.783884:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563598592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562321.784016:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562321.784163:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598592 00000100:00100000:2.0:1783562321.784178:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598592 00000100:00100000:2.0:1783562321.784253:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783562321.784271:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563598592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562321.784335:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562321.784437:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563598592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562321.784446:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783562321.784507:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6741180 x1870200563598592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562321.784532:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563598592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562321.784860:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563598464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562321.784912:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562321.784953:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598464 00000100:00100000:3.0:1783562321.784958:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598464 00000100:00100000:3.0:1783562321.784991:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783562321.784999:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563598464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562321.785029:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562321.785082:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563598464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562321.785089:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783562321.785118:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e2ad80 x1870200563598464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562321.785133:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563598464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783562321.847614:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562322.871832:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562323.894794:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562324.806832:0:9056:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.105 00010000:00010000:0.0:1783562324.920080:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562325.441661:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562325.441755:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562325.441785:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562325.441817:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562325.441866:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085696 00000100:00100000:2.0:1783562325.441877:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085696 00000100:00100000:2.0:1783562325.441948:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 185 00000100:00100000:2.0:1783562325.441959:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553085696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562325.442075:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553085696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562325.442076:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086080 00000100:00100000:1.0:1783562325.442081:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086080 00000100:00100000:2.0:1783562325.442084:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 185 00000100:00100000:1.0:1783562325.442125:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085952 00000100:00100000:1.0:1783562325.442128:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085952 00000100:00100000:1.0:1783562325.442165:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:1.0:1783562325.442173:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553086080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562325.442206:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553086080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562325.442212:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:1.0:1783562325.442223:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562325.442229:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553085952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562325.442250:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553085952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562325.442256:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00080000:2.0:1783562325.442280:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783562325.442285:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562325.442976:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553085824 00000100:00100000:3.0:1783562325.442984:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553085824 00000100:00100000:3.0:1783562325.443082:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:3.0:1783562325.443091:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553085824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562325.443138:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553085824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 49us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562325.443146:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00080000:2.0:1783562325.443214:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783562325.942943:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562326.391011:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563598848:0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391090:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562326.391169:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563599360:0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391197:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562326.391230:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783562326.391237:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563598720:0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391266:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562326.391288:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563599232:0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391309:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562326.391342:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599360 00000100:00100000:1.0:1783562326.391349:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599360 00000100:00100000:1.0:1783562326.391426:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562326.391437:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563599360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391489:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563599360:12345-0@lo:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562326.391496:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562326.391520:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598720 00000100:00100000:1.0:1783562326.391523:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598720 00000100:00100000:1.0:1783562326.391549:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783562326.391555:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3273:x1870200563598720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562326.391584:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3273:x1870200563598720:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562326.391590:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783562326.391616:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598848 00000100:00100000:1.0:1783562326.391620:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598848 00000100:00100000:0.0:1783562326.391844:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599232 00000100:00100000:0.0:1783562326.391848:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599232 00000100:00100000:0.0:1783562326.391876:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783562326.391883:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563598848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562326.391916:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563598848:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562326.391922:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783562326.391932:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783562326.391938:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563599232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562326.391959:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563599232:12345-0@lo:400:kworker.0 Request processed in 22us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562326.391986:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783562326.392024:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783562326.392029:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562326.392054:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563598720:0@lo:400:kworker.0 00000100:00100000:0.0:1783562326.392067:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563599232:0@lo:400:kworker.0 00000100:00100000:0.0:1783562326.392076:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563598848:0@lo:400:kworker.0 00010000:00080000:0.0:1783562326.392087:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e2b480 x1870200563599360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562326.392097:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563599360:0@lo:400:kworker.0 00000100:00100000:3.0:1783562326.392623:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563598976:0@lo:400:kworker.0 00000100:00100000:3.0:1783562326.392669:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562326.392696:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562326.392703:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599104:0@lo:400:kworker.0 00000100:00100000:3.0:1783562326.392728:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562326.392759:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563598976 00000100:00100000:0.0:1783562326.392763:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563598976 00000100:00100000:3.0:1783562326.392765:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599104 00000100:00100000:3.0:1783562326.392768:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599104 00000100:00100000:0.0:1783562326.392795:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783562326.392797:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783562326.392801:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563598976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562326.392802:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562326.392909:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563598976:12345-0@lo:400:kworker.0 Request processed in 106us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562326.392916:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783562326.392935:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783562326.392940:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562326.393373:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599104:12345-0@lo:400:kworker.0 Request processed in 568us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562326.393381:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783562326.393582:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e28e00 x1870200563599104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562326.393598:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599104:0@lo:400:kworker.0 00000100:00100000:3.0:1783562326.393610:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563598976:0@lo:400:kworker.0 00000001:02000400:0.0:1783562326.458832:0:9153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.105 00000100:00100000:3.0:1783562326.902686:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562326.902771:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562326.902885:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599488 00000100:00100000:2.0:1783562326.902897:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599488 00000100:00100000:2.0:1783562326.903070:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783562326.903083:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562326.903130:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562326.903191:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562326.903198:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783562326.903360:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6741c00 x1870200563599488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562326.903517:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562326.903546:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562326.903555:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562326.903586:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562326.904169:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599616 00000100:00100000:2.0:1783562326.904176:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599616 00000100:00100000:3.0:1783562326.904319:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562326.904330:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562326.904360:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562326.905002:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563599616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 671us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562326.905011:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1783562326.905285:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e2b480 x1870200563599616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562326.905308:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563599616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783562326.967678:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562327.990572:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562328.046824:0:9251:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.105 00010000:00010000:0.0:1783562329.016737:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783562329.108034:0:9299:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Jul 8 21:58:46 EDT 2026 00010000:00010000:1.0:1783562330.038756:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562330.558516:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562330.558554:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562330.558596:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086208 00000100:00100000:2.0:1783562330.558605:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086336 00000100:00100000:3.0:1783562330.558616:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086208 00000100:00100000:2.0:1783562330.558616:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086336 00000100:00100000:3.0:1783562330.558723:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 187 00000100:00080000:0.0:1783562330.558728:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562330.558735:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:2361:x1870200553086208:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562330.558756:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562330.558770:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553086336:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562330.558860:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+10:2361:x1870200553086208:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562330.558862:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553086336:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562330.558886:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:3.0:1783562330.558905:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 187 00000100:00100000:0.0:1783562330.563562:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562330.563718:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086464 00000100:00100000:0.0:1783562330.563732:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562330.563738:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086464 00000100:00080000:0.0:1783562330.563802:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562330.563815:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086592 00000100:00100000:2.0:1783562330.563821:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086592 00000100:00100000:3.0:1783562330.563846:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:2.0:1783562330.563878:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562330.563889:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2360:x1870200553086592:12345-192.168.204.4@tcp:9:kworker.0 00000100:00080000:0.0:1783562330.563920:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562330.563953:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2360:x1870200553086464:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1783562330.563959:0:6549:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87dd7 00000100:00080000:2.0:1783562330.563974:0:6549:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6941000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783562330.563983:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87dd0 00000100:00080000:3.0:1783562330.563994:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6166800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783562330.564036:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1783562330.564037:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783562330.564576:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+2:2360:x1870200553086592:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 688us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562330.564598:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:3.0:1783562330.564623:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+2:2360:x1870200553086464:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 761us (1070us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562330.564625:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562330.564638:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00010000:00010000:3.0:1783562330.564697:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562331.062732:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562331.512492:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563599872:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512649:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562331.512711:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563600384:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512742:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562331.512780:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783562331.512787:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563599744:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512822:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562331.512846:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563600256:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512863:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562331.512899:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563600000:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512924:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562331.512946:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562331.512951:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600128:0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.512972:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562331.513002:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599744 00000100:00100000:2.0:1783562331.513013:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599744 00000100:00100000:1.0:1783562331.513240:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563599872 00000100:00100000:1.0:1783562331.513245:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563599872 00000100:00100000:1.0:1783562331.513275:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600256 00000100:00100000:1.0:1783562331.513279:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600256 00000100:00100000:1.0:1783562331.513300:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600000 00000100:00100000:1.0:1783562331.513303:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600000 00000100:00100000:1.0:1783562331.513319:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783562331.513328:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563599872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.513391:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563599872:12345-0@lo:400:kworker.0 Request processed in 64us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562331.513398:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783562331.513435:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783562331.513441:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.513468:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563600256:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562331.513474:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783562331.513483:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783562331.513489:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563600000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.513512:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563600000:12345-0@lo:400:kworker.0 Request processed in 23us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562331.513517:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783562331.514141:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600384 00000100:00100000:3.0:1783562331.514143:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563600000:0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.514149:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600384 00000100:00100000:3.0:1783562331.514198:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600128 00000100:00100000:3.0:1783562331.514204:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600128 00000100:00100000:2.0:1783562331.514204:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783562331.514233:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3273:x1870200563599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.514254:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783562331.514264:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562331.514294:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3273:x1870200563599744:12345-0@lo:400:kworker.0 Request processed in 78us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562331.514306:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783562331.514307:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783562331.514320:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563600384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562331.514321:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600128:12345-0@lo:400:kworker.0 Request processed in 57us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562331.514341:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783562331.514371:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563600384:12345-0@lo:400:kworker.0 Request processed in 54us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562331.514380:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1783562331.514395:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef9c9500 x1870200563600128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783562331.514429:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562331.514441:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600128:0@lo:400:kworker.0 00000100:00080000:2.0:1783562331.514447:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783562331.514452:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562331.514613:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563599744:0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.514630:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563600256:0@lo:400:kworker.0 00000100:00100000:1.0:1783562331.514642:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563599872:0@lo:400:kworker.0 00010000:00080000:1.0:1783562331.514652:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef698a80 x1870200563600384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562331.514661:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563600384:0@lo:400:kworker.0 00000100:00100000:0.0:1783562332.022607:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562332.022697:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562332.022750:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562332.022770:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562332.022810:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600640 00000100:00100000:0.0:1783562332.022819:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600640 00000100:00100000:0.0:1783562332.022883:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600512 00000100:00100000:0.0:1783562332.022887:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600512 00000100:00100000:0.0:1783562332.022904:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783562332.022912:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783562332.022953:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562332.023012:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562332.023022:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783562332.023039:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783562332.023045:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562332.023063:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562332.023086:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563600512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562332.023092:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783562332.023134:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef698a80 x1870200563600640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562332.023166:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600640:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783562332.023178:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc7e2ad80 x1870200563600512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562332.023188:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563600512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783562332.087374:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783562333.079361:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:3.0:1783562333.079372:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfcf6167800/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:1.0:1783562333.079454:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6167800/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-OST0000 00000020:00000080:1.0:1783562333.079534:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf6166800 for lustre-OST0000 00010000:00010000:0.0:1783562333.110540:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562334.134587:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783562335.129679:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:1.0:1783562335.129693:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfbc6946800/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:3.0:1783562335.129739:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6946800/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-OST0001 00000020:00000080:3.0:1783562335.129800:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6941000 for lustre-OST0001 00010000:00010000:2.0:1783562335.158611:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562335.678395:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562335.678462:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562335.678840:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086848 00000100:00100000:2.0:1783562335.678852:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086848 00000100:00100000:2.0:1783562335.678925:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:2.0:1783562335.678939:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553086848:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562335.679027:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553086848:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562335.679036:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:2.0:1783562335.679063:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086720 00000100:00100000:2.0:1783562335.679067:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086720 00000100:00100000:2.0:1783562335.679090:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 189 00000100:00100000:2.0:1783562335.679096:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:2362:x1870200553086720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562335.679120:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+10:2362:x1870200553086720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562335.679126:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 189 00000100:00080000:2.0:1783562335.679161:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783562336.182848:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562336.631141:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563601152:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631240:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562336.631322:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783562336.631329:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563600768:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631361:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562336.631385:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563601280:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631432:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562336.631467:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563600896:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631492:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562336.631510:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563601408:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631533:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562336.631551:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562336.631556:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563601024:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.631579:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562336.631614:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601152 00000100:00100000:0.0:1783562336.631616:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600768 00000100:00100000:0.0:1783562336.631624:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600768 00000100:00100000:2.0:1783562336.631625:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601152 00000100:00100000:2.0:1783562336.631684:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601408 00000100:00100000:2.0:1783562336.631688:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601408 00000100:00100000:0.0:1783562336.631692:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783562336.631716:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783562336.631736:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563600768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562336.631737:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563601152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562336.631856:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601280 00000100:00100000:3.0:1783562336.631861:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601280 00000100:00100000:3.0:1783562336.631897:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563600896 00000100:00100000:3.0:1783562336.631899:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563600896 00000100:00100000:3.0:1783562336.631913:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601024 00000100:00100000:3.0:1783562336.631916:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601024 00000100:00100000:3.0:1783562336.631934:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783562336.631941:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563601280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.632107:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563600768:12345-0@lo:400:kworker.0 Request processed in 378us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562336.632115:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783562336.632151:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783562336.632164:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563600896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.632196:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563600896:12345-0@lo:400:kworker.0 Request processed in 39us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562336.632203:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783562336.632216:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783562336.632221:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563601024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.632246:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563601024:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562336.632252:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783562336.632298:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563601024:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.632311:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563600896:0@lo:400:kworker.0 00000100:00100000:0.0:1783562336.632352:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc7e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563600768:0@lo:400:kworker.0 00000100:00100000:1.0:1783562336.632649:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783562336.632661:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563601152:12345-0@lo:400:kworker.0 Request processed in 931us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562336.632665:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563601408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562336.632674:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783562336.632711:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783562336.632715:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6639180 x1870200563601152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783562336.632720:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562336.632724:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562336.632729:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563601408:12345-0@lo:400:kworker.0 Request processed in 67us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562336.632737:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563601152:0@lo:400:kworker.0 00000100:00100000:1.0:1783562336.632744:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1783562336.632799:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6638380 x1870200563601408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562336.632812:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563601408:0@lo:400:kworker.0 00000100:00100000:3.0:1783562336.637121:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563601280:12345-0@lo:400:kworker.0 Request processed in 5165us (5673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562336.637141:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783562336.637331:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563601280:0@lo:400:kworker.0 00000100:00100000:1.0:1783562337.142709:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562337.142759:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563601536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562337.142893:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562337.143100:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563601664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562337.143134:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562337.143468:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601536 00000100:00100000:0.0:1783562337.143480:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601536 00000100:00100000:0.0:1783562337.143571:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601664 00000100:00100000:0.0:1783562337.143575:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601664 00000100:00100000:0.0:1783562337.143595:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783562337.143603:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563601536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562337.143642:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562337.143689:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563601536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562337.143698:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783562337.143716:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783562337.143722:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563601664:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783562337.143866:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf663a300 x1870200563601536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562337.143889:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563601536:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562337.143950:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562337.144033:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563601664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 310us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562337.144046:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1783562337.144177:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef698a80 x1870200563601664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562337.144193:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563601664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783562337.206668:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562338.069241:0:9930:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:58:56 (1783562336) === 00010000:00010000:1.0:1783562338.230694:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562338.334172:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.334294:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553086976 00000100:00100000:0.0:1783562338.334306:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553086976 00000100:00100000:0.0:1783562338.334449:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:0.0:1783562338.334460:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+10:8109:x1870200553086976:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562338.334481:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562338.334503:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8e00/0x4738ba0933b87e9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21104 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.334536:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8e00/0x4738ba0933b87e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21104 expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.334546:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8e00/0x4738ba0933b87e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21104 expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.334569:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8e00, rc 0) 00000100:00100000:0.0:1783562338.334628:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553086976:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.334636:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:2.0:1783562338.340051:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.340166:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087104 00000100:00100000:0.0:1783562338.340177:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087104 00000100:00100000:0.0:1783562338.340273:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 192 00000100:00100000:0.0:1783562338.340285:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553087104:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562338.340635:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553087104:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 352us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.340643:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 192 00000100:00100000:1.0:1783562338.343560:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.343857:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087232 00000100:00100000:0.0:1783562338.343871:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087232 00000100:00100000:0.0:1783562338.344179:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:0.0:1783562338.344192:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553087232:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783562338.344440:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553087232:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 250us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.344786:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:3.0:1783562338.348366:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.348631:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087360 00000100:00100000:0.0:1783562338.348640:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087360 00000100:00100000:0.0:1783562338.348690:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 194 00000100:00100000:0.0:1783562338.348698:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:8113:x1870200553087360:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562338.348996:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:8113:x1870200553087360:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 296us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.349014:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 194 00000100:00100000:3.0:1783562338.361054:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.361173:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087488 00000100:00100000:0.0:1783562338.361184:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087488 00000100:00100000:0.0:1783562338.361246:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 195 00000100:00100000:0.0:1783562338.361256:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+11:8113:x1870200553087488:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562338.361618:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+11:8113:x1870200553087488:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 362us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.361626:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 195 00000100:00100000:1.0:1783562338.363675:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.363735:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087616 00000100:00100000:0.0:1783562338.363744:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087616 00000100:00100000:0.0:1783562338.363810:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00100000:0.0:1783562338.363821:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:8109:x1870200553087616:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562338.363837:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562338.363857:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b87ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2112e expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.363894:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b87ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2112e expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.363903:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b87ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2112e expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562338.363911:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8400, rc 0) 00000100:00100000:0.0:1783562338.363954:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:8109:x1870200553087616:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 136us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.363961:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00100000:3.0:1783562338.365809:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.365880:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087744 00000100:00100000:0.0:1783562338.365891:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087744 00000100:00100000:0.0:1783562338.365943:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 197 00000100:00100000:0.0:1783562338.365954:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:8109:x1870200553087744:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783562338.365982:0:5749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783562338.366011:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783562338.366015:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783562338.366017:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783562338.366019:0:5749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1783562338.367150:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:8109:x1870200553087744:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 1193us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.367162:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 197 00000100:00100000:1.0:1783562338.372669:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562338.372851:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553087872 00000100:00100000:2.0:1783562338.372862:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553087872 00000100:00100000:2.0:1783562338.372937:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 198 00000100:00100000:2.0:1783562338.372949:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+12:8109:x1870200553087872:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783562338.372965:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562338.372984:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21135 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562338.373031:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562338.373045:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562338.373075:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1da00, rc 0) 00000100:00100000:2.0:1783562338.373345:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:8109:x1870200553087872:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 398us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562338.373350:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 198 00000100:00100000:3.0:1783562338.376301:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.376362:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088000 00000100:00100000:0.0:1783562338.376374:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088000 00000100:00100000:0.0:1783562338.376462:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 199 00000100:00100000:0.0:1783562338.376470:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:8109:x1870200553088000:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562338.376739:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:8109:x1870200553088000:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 269us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.376758:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 199 00000100:00100000:3.0:1783562338.379689:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562338.379886:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088128 00000100:00100000:2.0:1783562338.379898:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088128 00000100:00100000:0.0:1783562338.380047:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 200 00000100:00100000:0.0:1783562338.380061:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:8109:x1870200553088128:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783562338.380654:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:8109:x1870200553088128:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 595us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.380663:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 200 00000100:00100000:1.0:1783562338.384231:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.384351:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088256 00000100:00100000:0.0:1783562338.384362:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088256 00000100:00100000:0.0:1783562338.384468:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 201 00000100:00100000:0.0:1783562338.384479:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:8116:x1870200553088256:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562338.384763:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:8116:x1870200553088256:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 285us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.384771:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 201 00000100:00100000:3.0:1783562338.389983:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.390092:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088384 00000100:00100000:0.0:1783562338.390102:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088384 00000100:00100000:0.0:1783562338.390166:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:0.0:1783562338.390176:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:8116:x1870200553088384:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562338.390455:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:8116:x1870200553088384:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 279us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.390464:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:3.0:1783562338.395043:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.395771:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088512 00000100:00100000:0.0:1783562338.395782:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088512 00000100:00100000:0.0:1783562338.395841:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1783562338.395849:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1870200553088512:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783562338.395884:0:6572:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 952ad7e8-5645-4c1a-9bc5-e30bd45f3803@192.168.204.4@tcp t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:0.0:1783562338.395929:0:6572:0:(genops.c:1406:class_connect()) connect: client 952ad7e8-5645-4c1a-9bc5-e30bd45f3803, cookie 0x4738ba0933b87eb0 00000004:00100000:0.0:1783562338.395964:0:6572:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783562338.396245:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562338.396987:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2360:x1870200553088512:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 1136us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.396996:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562338.397059:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562338.397597:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088896 00000100:00100000:2.0:1783562338.397603:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088896 00000100:00100000:2.0:1783562338.397643:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562338.397652:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553088896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562338.397709:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553088896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 57us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562338.397716:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00080000:0.0:1783562338.397741:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562338.399046:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562338.399068:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562338.399120:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088768 00000100:00100000:2.0:1783562338.399125:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088768 00000100:00080000:3.0:1783562338.399154:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562338.399181:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553088640 00000100:00100000:0.0:1783562338.399195:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553088640 00000100:00100000:0.0:1783562338.399318:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562338.399328:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+7:8109:x1870200553088768:12345-192.168.204.4@tcp:41:mount.lustre.0 00000100:00100000:2.0:1783562338.399340:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:2.0:1783562338.399347:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+7:0:x1870200553088640:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783562338.399360:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1783562338.399360:0:6572:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783562338.400159:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+7:8109:x1870200553088768:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 830us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.400168:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562338.400329:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:0:x1870200553088640:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 981us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562338.400335:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:2.0:1783562338.401827:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562338.401923:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089024 00000100:00100000:3.0:1783562338.401932:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089024 00000100:00100000:3.0:1783562338.402038:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562338.402050:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:8109:x1870200553089024:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783562338.402169:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:8109:x1870200553089024:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562338.402177:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562338.403939:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562338.404037:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562338.404091:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562338.404140:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089408 00000100:00100000:0.0:1783562338.404152:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089408 00000100:00100000:0.0:1783562338.404250:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:0.0:1783562338.404260:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:8109:x1870200553089408:12345-192.168.204.4@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783562338.404581:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783562338.404698:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:8109:x1870200553089408:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 439us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562338.404705:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562338.404997:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089152 00000100:00100000:2.0:1783562338.405002:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089152 00000100:00100000:0.0:1783562338.405240:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089280 00000100:00100000:0.0:1783562338.405245:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089280 00000100:00100000:0.0:1783562338.405352:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562338.405360:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870200553089152:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783562338.405388:0:6550:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 952ad7e8-5645-4c1a-9bc5-e30bd45f3803@192.168.204.4@tcp t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:0.0:1783562338.405451:0:6550:0:(genops.c:1406:class_connect()) connect: client 952ad7e8-5645-4c1a-9bc5-e30bd45f3803, cookie 0x4738ba0933b87eb7 00002000:00100000:0.0:1783562338.405464:0:6550:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 952ad7e8-5645-4c1a-9bc5-e30bd45f3803/ffff9bfcef3a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562338.405481:0:6550:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783562338.405678:0:6550:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783562338.405705:0:6550:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562338.405741:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:2.0:1783562338.405767:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553089280:12345-192.168.204.4@tcp:8:mount.lustre.0 00000100:00100000:0.0:1783562338.405786:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2360:x1870200553089152:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 423us (1850us total) trans 0 rc 0/0 00010000:00080000:2.0:1783562338.405788:0:6547:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 952ad7e8-5645-4c1a-9bc5-e30bd45f3803@192.168.204.4@tcp t0 exp 0000000000000000 cur 147 last 0 00000100:00100000:0.0:1783562338.405803:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000020:00000080:2.0:1783562338.405813:0:6547:0:(genops.c:1406:class_connect()) connect: client 952ad7e8-5645-4c1a-9bc5-e30bd45f3803, cookie 0x4738ba0933b87ebe 00002000:00100000:2.0:1783562338.405820:0:6547:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 952ad7e8-5645-4c1a-9bc5-e30bd45f3803/ffff9bfcef655800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783562338.405827:0:6547:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783562338.406003:0:6547:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783562338.406018:0:6547:0:(import.c:65:import_set_state_nolock()) ffff9bfcef657000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562338.406061:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2360:x1870200553089280:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 294us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562338.406069:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00010000:00010000:0.0:1783562339.254576:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783562340.233014:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00000001:00100000:1.0:1783562340.237256:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00010000:00010000:2.0:1783562340.278644:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562341.165004:0:10125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783562341.302617:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562341.750871:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563602176:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.750967:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751118:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783562341.751125:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563601792:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751165:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751189:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563602304:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751215:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751246:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563601920:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751272:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751291:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563602432:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751312:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751330:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562341.751335:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563602048:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751356:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562341.751390:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602176 00000100:00100000:1.0:1783562341.751430:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602176 00000100:00100000:1.0:1783562341.751491:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602432 00000100:00100000:1.0:1783562341.751495:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602432 00000100:00100000:1.0:1783562341.751520:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562341.751530:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563602176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751585:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563602176:12345-0@lo:400:kworker.0 Request processed in 57us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751593:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562341.751611:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783562341.751616:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563602432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751642:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563602432:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751648:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783562341.751664:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601792 00000100:00100000:1.0:1783562341.751667:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601792 00000100:00100000:1.0:1783562341.751709:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783562341.751715:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563601792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751743:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563601792:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751748:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783562341.751777:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602304 00000100:00100000:1.0:1783562341.751781:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602304 00000100:00100000:1.0:1783562341.751805:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563601920 00000100:00100000:1.0:1783562341.751808:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563601920 00000100:00100000:1.0:1783562341.751817:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602048 00000100:00100000:1.0:1783562341.751819:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602048 00000100:00100000:1.0:1783562341.751833:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783562341.751839:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563602304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751866:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563602304:12345-0@lo:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751871:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783562341.751880:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562341.751885:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563601920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751905:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563601920:12345-0@lo:400:kworker.0 Request processed in 20us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751910:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562341.751918:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783562341.751923:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563602048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.751943:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563602048:12345-0@lo:400:kworker.0 Request processed in 20us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562341.751948:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783562341.752607:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563602048:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.752632:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563601920:0@lo:400:kworker.0 00010000:00080000:1.0:1783562341.752649:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1e8700 x1870200563602432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562341.752660:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563602432:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.752717:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563601792:0@lo:400:kworker.0 00000100:00100000:1.0:1783562341.752730:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563602304:0@lo:400:kworker.0 00010000:00080000:1.0:1783562341.752741:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1e9180 x1870200563602176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562341.752750:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563602176:0@lo:400:kworker.0 00000100:00080000:2.0:1783562341.753526:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783562341.753534:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562341.753537:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562342.263919:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562342.263998:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562342.264352:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783562342.264364:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563602688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562342.264396:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562342.264467:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602560 00000100:00100000:2.0:1783562342.264476:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602560 00000100:00100000:2.0:1783562342.264532:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602688 00000100:00100000:2.0:1783562342.264535:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602688 00000100:00100000:2.0:1783562342.264553:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783562342.264562:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563602560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562342.264604:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562342.264649:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563602560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562342.264657:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783562342.264700:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783562342.264707:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563602688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783562342.264729:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562342.264762:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563602688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562342.264768:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783562342.264813:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6743b80 x1870200563602688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562342.264837:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563602688:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783562342.264983:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6639180 x1870200563602560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562342.264997:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563602560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783562342.327570:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783562343.319732:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00010000:00010000:0.0:1783562343.350782:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562343.873108:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562343.873156:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562343.873162:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089536 00000100:00100000:2.0:1783562343.873178:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089536 00000100:00100000:3.0:1783562343.873268:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562343.873298:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562343.873321:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562343.873486:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:2.0:1783562343.873501:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553089536:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562343.873522:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089792 00000100:00100000:0.0:1783562343.873529:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089792 00000100:00100000:0.0:1783562343.873583:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089664 00000100:00100000:0.0:1783562343.873586:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089664 00000100:00080000:3.0:1783562343.873592:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562343.873617:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:3.0:1783562343.873628:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:0.0:1783562343.873638:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553089792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562343.873656:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553089664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562343.873671:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553089536:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 100us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562343.873682:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:0.0:1783562343.873691:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553089792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 65us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562343.873699:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:3.0:1783562343.873866:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553089664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 228us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562343.873871:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:2.0:1783562343.874480:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090048 00000100:00100000:2.0:1783562343.874487:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090048 00000100:00100000:2.0:1783562343.874530:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553089920 00000100:00100000:2.0:1783562343.874535:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553089920 00000100:00100000:2.0:1783562343.874567:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:2.0:1783562343.874577:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553090048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562343.874748:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553090048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 122us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562343.874758:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:2.0:1783562343.874775:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:2.0:1783562343.874793:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553089920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562343.874836:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553089920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562343.874845:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00080000:2.0:1783562343.874882:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783562343.874887:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783562344.374909:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562345.398933:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562346.423961:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562346.871622:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563602816:0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.871700:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562346.871756:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563603072:0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.871764:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563603328:0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.871797:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562346.871813:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562346.871822:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562346.871828:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563603200:0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.871854:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783562346.871864:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563602944:0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.871907:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562346.871933:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602816 00000100:00100000:0.0:1783562346.871939:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602816 00000100:00100000:2.0:1783562346.871949:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562346.871977:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563603456:0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.871995:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783562346.872003:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562346.872008:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563602816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872045:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603328 00000100:00100000:2.0:1783562346.872050:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603328 00000100:00100000:0.0:1783562346.872068:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563602816:12345-0@lo:400:kworker.0 Request processed in 64us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562346.872081:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783562346.872095:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603072 00000100:00100000:2.0:1783562346.872100:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603072 00000100:00100000:0.0:1783562346.872117:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563602944 00000100:00100000:0.0:1783562346.872123:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563602944 00000100:00100000:2.0:1783562346.872129:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783562346.872140:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563603328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.872157:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783562346.872169:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563603072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872187:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563603328:12345-0@lo:400:kworker.0 Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562346.872196:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783562346.872215:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783562346.872227:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563603072:12345-0@lo:400:kworker.0 Request processed in 59us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562346.872235:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783562346.872262:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603200 00000100:00100000:0.0:1783562346.872267:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603200 00000100:00100000:0.0:1783562346.872307:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603456 00000100:00100000:0.0:1783562346.872310:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603456 00000100:00100000:2.0:1783562346.872328:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563602944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562346.872342:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783562346.872351:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563603200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872385:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563602944:12345-0@lo:400:kworker.0 Request processed in 162us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562346.872397:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563603200:12345-0@lo:400:kworker.0 Request processed in 45us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562346.872433:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783562346.872463:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783562346.872484:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563603456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872525:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563603456:12345-0@lo:400:kworker.0 Request processed in 54us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562346.872534:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783562346.872558:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562346.872564:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562346.872568:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1783562346.872569:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562346.872644:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563602944:0@lo:400:kworker.0 00010000:00080000:2.0:1783562346.872660:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6638380 x1870200563603456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562346.872670:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563603456:0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872681:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563603072:0@lo:400:kworker.0 00010000:00080000:2.0:1783562346.872721:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6639180 x1870200563603200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562346.872728:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563603200:0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872735:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563602816:0@lo:400:kworker.0 00000100:00100000:2.0:1783562346.872743:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563603328:0@lo:400:kworker.0 00000100:00100000:0.0:1783562347.382600:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563603584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562347.382706:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562347.382733:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562347.382758:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603584 00000100:00100000:3.0:1783562347.382767:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603584 00000100:00100000:2.0:1783562347.382772:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562347.383091:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603712 00000100:00100000:0.0:1783562347.383103:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783562347.383105:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603712 00000100:00100000:0.0:1783562347.383114:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563603584:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562347.383140:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00002000:00000024:0.0:1783562347.383144:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562347.383151:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563603712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562347.383177:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562347.383230:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563603712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562347.383236:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563603584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562347.383243:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783562347.383313:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783562347.383367:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6520380 x1870200563603712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783562347.383374:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6741f80 x1870200563603584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562347.383393:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562347.383396:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563603584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783562347.447039:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562348.471542:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562348.989475:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562348.989528:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562348.989540:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090304 00000100:00100000:2.0:1783562348.989562:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090304 00000100:00100000:0.0:1783562348.989577:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562348.989609:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562348.989635:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090432 00000100:00100000:2.0:1783562348.989640:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090432 00000100:00100000:0.0:1783562348.989658:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562348.989677:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:2.0:1783562348.989689:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553090304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562348.989690:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090560 00000100:00100000:0.0:1783562348.989697:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090560 00000100:00100000:0.0:1783562348.989734:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090688 00000100:00100000:0.0:1783562348.989738:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090688 00000100:00100000:0.0:1783562348.989764:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:0.0:1783562348.989773:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553090560:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562348.989795:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553090304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 108us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562348.989804:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:0.0:1783562348.989811:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553090560:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562348.989819:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:2.0:1783562348.989830:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:0.0:1783562348.989839:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:2.0:1783562348.989843:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553090432:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562348.989853:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553090688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562348.989875:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553090432:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562348.989882:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:0.0:1783562348.989889:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553090688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562348.989898:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00080000:2.0:1783562348.989902:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562348.989908:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783562348.989911:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562348.990147:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090176 00000100:00100000:3.0:1783562348.990152:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090176 00000100:00100000:3.0:1783562348.990246:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 206 00000100:00100000:3.0:1783562348.990254:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2363:x1870200553090176:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562348.990295:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2363:x1870200553090176:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562348.990301:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 206 00010000:00010000:2.0:1783562349.494606:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562349.698077:0:10826:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783562350.518637:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562351.427174:0:10974:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8e2fe1f0 20000000:00000080:2.0:1783562351.427194:0:10974:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfceed6d400 uarg=0000000000000000 20000000:01000000:2.0:1783562351.427237:0:10974:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783562351.427243:0:10974:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783562351.427250:0:10974:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783562351.428613:0:10975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1783562351.428968:0:10974:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783562351.435772:0:10974:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783562351.436117:0:10974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436145:0:10974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436156:0:10974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436163:0:10974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436170:0:10974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436178:0:10974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436186:0:10974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436246:0:10974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436263:0:10974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 12 pid: 5748 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562351.436280:0:10974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563603840:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562351.436444:0:10974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436453:0:10974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 18 pid: 5750 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562351.436463:0:10974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563603968:0@lo:104: 00000100:00100000:3.0:1783562351.436536:0:10974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562351.436575:0:10974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436585:0:10974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562351.436594:0:10974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6521f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604096:0@lo:104: 00000100:00100000:3.0:1783562351.436613:0:10974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562351.436630:0:10974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436636:0:10974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 18 pid: 5748 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562351.436655:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563603968 00000100:00100000:3.0:1783562351.436662:0:10974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604224:0@lo:104: 00000100:00100000:0.0:1783562351.436667:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563603968 00000100:00100000:3.0:1783562351.436681:0:10974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562351.436701:0:10974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562351.436707:0:10974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562351.436713:0:10974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604352:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562351.436735:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604096 00000100:00100000:0.0:1783562351.436740:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604096 00000100:00100000:3.0:1783562351.436743:0:10974:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562351.436760:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604224 00000100:00100000:0.0:1783562351.436764:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604224 00000100:00100000:0.0:1783562351.436779:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783562351.436791:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:10974:x1870200563603968:12345-0@lo:104: 00010000:00010000:0.0:1783562351.436815:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.436893:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562351.436900:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:10974:x1870200563603968:12345-0@lo:104: Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562351.436909:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783562351.436930:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783562351.436936:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:10974:x1870200563604096:12345-0@lo:104: 00010000:00010000:0.0:1783562351.436943:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.436980:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783562351.436986:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:10974:x1870200563604096:12345-0@lo:104: Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562351.436991:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783562351.437003:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783562351.437008:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:10974:x1870200563604224:12345-0@lo:104: 00010000:00010000:0.0:1783562351.437015:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437046:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783562351.437052:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:10974:x1870200563604224:12345-0@lo:104: Request processed in 43us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562351.437058:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1783562351.437074:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783562351.437081:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437096:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562351.437100:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437109:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562351.437116:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562351.437124:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783562351.437164:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437169:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562351.437197:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437201:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b87e8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e94 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437219:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562351.437221:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437226:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562351.437228:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437241:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562351.437246:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562351.437252:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783562351.437264:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437267:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562351.437281:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562351.437290:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437302:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437308:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b87e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e86 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437317:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562351.437319:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562351.437320:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562351.437328:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563604480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562351.437364:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563604608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562351.437450:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562351.437479:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562351.437523:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604608 00000100:00100000:0.0:1783562351.437529:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604608 00010000:00010000:0.0:1783562351.437566:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 19 pid: 5749 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562351.437583:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604480 00000100:00100000:1.0:1783562351.437593:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604480 00000100:00100000:0.0:1783562351.437612:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783562351.437616:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562351.437622:0:8323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562351.437629:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3272:x1870200563604608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562351.437631:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 20 pid: 5750 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.437637:0:8323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437666:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562351.437676:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 20 pid: 5749 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.437693:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 20 pid: 5749 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562351.437697:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562351.437713:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3275:x1870200563604480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562351.437728:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562351.437731:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562351.437741:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 20 pid: 5750 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.437753:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 20 pid: 5750 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.437773:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562351.437782:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3272:x1870200563604608:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562351.437792:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783562351.437834:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563604480:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562351.437845:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783562351.437879:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563604608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562351.437959:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562351.437966:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563604480:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1783562351.438004:0:8323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562351.438012:0:8323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783562351.438045:0:8323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.438051:0:8323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562351.438074:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.438081:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b87e71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87e78 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562351.438082:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562351.438099:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563604736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562351.438127:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562351.438131:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562351.438134:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562351.438144:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562351.438193:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604736 00010000:00010000:2.0:1783562351.438196:0:10974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b87e94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87e8d expref: 18 pid: 5750 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562351.438204:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604736 00000100:00100000:2.0:1783562351.438220:0:10974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563603968:0@lo:104: 00010000:00010000:1.0:1783562351.438234:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 18 pid: 5748 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.438245:0:10974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9400/0x4738ba0933b87e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87e7f expref: 18 pid: 5749 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562351.438260:0:10974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6521f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604096:0@lo:104: 00000100:00100000:1.0:1783562351.438283:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783562351.438286:0:10974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604224:0@lo:104: 00000100:00100000:1.0:1783562351.438301:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3272:x1870200563604736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562351.438347:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562351.438357:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 17 pid: 5748 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.438369:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 17 pid: 5748 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.438385:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8200/0x4738ba0933b87e78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87e71 expref: 17 pid: 5748 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.438454:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562351.438530:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3272:x1870200563604736:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562351.438538:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783562351.438920:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563604736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562351.439982:0:10974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563603840:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562351.442186:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562351.442205:0:10974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10974:1870200563604352:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562351.442266:0:10974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562351.442316:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562351.442325:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090816 00000100:00100000:1.0:1783562351.442344:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090816 00010000:00010000:1.0:1783562351.442467:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562351.442535:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562351.442550:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553090816:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562351.442574:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562351.442581:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.442598:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.442634:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b87ea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21135 expref: 13 pid: 5748 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562351.442686:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562351.442757:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553090944 00000100:00100000:2.0:1783562351.442770:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553090944 00000100:00100000:1.0:1783562351.442779:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553090816:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 230us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562351.442795:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00010000:00010000:2.0:1783562351.442823:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 13 pid: 5749 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562351.443137:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:2.0:1783562351.443149:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+12:2363:x1870200553090944:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562351.443168:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562351.443176:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443190:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443234:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b87e6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210fd expref: 12 pid: 5749 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443256:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443265:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443282:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443289:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443295:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443301:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443307:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562351.443312:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443320:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443343:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562351.443363:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562351.443426:0:10974:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.443437:0:10974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562351.443444:0:10974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b87ec5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562351.443454:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+11:2363:x1870200553090944:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 306us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562351.443463:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00010000:00010000:1.0:1783562351.545589:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562351.991844:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563605248:0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.991885:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563604992:0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.991990:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563605120:0@lo:400:kworker.0 00000100:00100000:0.0:1783562351.992099:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563604864:0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.992730:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562351.992787:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562351.992856:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604992 00000100:00100000:2.0:1783562351.992869:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604992 00000100:00100000:3.0:1783562351.992884:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563605504:0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.992930:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562351.992944:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605120 00000100:00100000:2.0:1783562351.992949:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605120 00000100:00100000:2.0:1783562351.992998:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783562351.993010:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563604992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.993098:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563604992:12345-0@lo:400:kworker.0 Request processed in 89us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562351.993099:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562351.993145:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605504 00000100:00100000:1.0:1783562351.993150:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605504 00000100:00100000:1.0:1783562351.993185:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605248 00000100:00100000:1.0:1783562351.993188:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605248 00000100:00100000:1.0:1783562351.993212:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783562351.993221:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.993371:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783562351.993383:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563605120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.993596:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783562351.993630:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562351.993631:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563605120:12345-0@lo:400:kworker.0 Request processed in 251us (844us total) trans 0 rc 0/0 00000100:00080000:2.0:1783562351.993638:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562351.993643:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1783562351.993643:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562351.993709:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563604992:0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.993710:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563605120:0@lo:400:kworker.0 00010000:00080000:2.0:1783562351.993732:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1e8a80 x1870200563605504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562351.993746:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563605504:0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.993805:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783562351.993817:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563605248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.993857:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563605248:12345-0@lo:400:kworker.0 Request processed in 43us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562351.993864:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783562351.994027:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563605504:12345-0@lo:400:kworker.0 Request processed in 806us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562351.994034:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1783562351.994072:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1eb800 x1870200563605248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562351.994084:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563605248:0@lo:400:kworker.0 00000100:00100000:0.0:1783562351.994255:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562351.994297:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563605376:0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.994305:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563604864 00000100:00100000:0.0:1783562351.994339:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562351.994474:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563604864 00000100:00100000:2.0:1783562351.994521:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783562351.994530:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563604864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562351.994592:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563604864:12345-0@lo:400:kworker.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562351.994602:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783562351.994611:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563604864:0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.994879:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605376 00000100:00100000:3.0:1783562351.994885:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605376 00000100:00080000:2.0:1783562351.995009:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562351.995107:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783562351.995117:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563605376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562351.995175:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563605376:12345-0@lo:400:kworker.0 Request processed in 60us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562351.995181:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783562351.995237:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563605376:0@lo:400:kworker.0 00000100:00100000:3.0:1783562352.502833:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562352.502995:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562352.505638:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605632 00000100:00100000:3.0:1783562352.505669:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605632 00000100:00100000:3.0:1783562352.505806:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783562352.505828:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563605632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562352.505930:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562352.506100:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563605632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.506107:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783562352.506194:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6523b80 x1870200563605632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562352.506236:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562352.506310:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562352.506339:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562352.506460:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562352.507595:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605760 00000100:00100000:0.0:1783562352.507608:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605760 00000100:00100000:0.0:1783562352.507662:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783562352.507673:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563605760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562352.507715:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562352.507779:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563605760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562352.507786:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783562352.507833:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcc3eba300 x1870200563605760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562352.507854:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563605760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783562352.567573:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783562352.696139:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562352.696151:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfceec04800 from 7 10000000:01000000:1.0:1783562352.696157:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562352.696240:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.696274:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.696289:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562352.696322:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563605888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.696902:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.697539:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562352.697621:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563605888 00000100:00100000:3.0:1783562352.697631:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563605888 00000100:00100000:3.0:1783562352.697695:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783562352.697707:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563605888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562352.697727:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562352.697747:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87ecc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.697772:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.697784:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.697793:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337400, rc 0) 00000100:00100000:3.0:1783562352.697857:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563605888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.697864:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783562352.697936:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563605888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562352.697968:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.697995:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562352.698097:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.698146:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.698170:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562352.698187:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606016 00000100:00100000:3.0:1783562352.698193:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606016 00000100:00100000:3.0:1783562352.698221:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783562352.698228:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563606016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.698696:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563606016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.698712:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783562352.698774:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.698882:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.698948:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.699348:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562352.699517:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606144 00000100:00100000:3.0:1783562352.699527:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606144 00000100:00100000:3.0:1783562352.699653:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783562352.699666:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563606144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.699934:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563606144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.699946:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783562352.700358:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562352.701008:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783562352.701113:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783562352.701127:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562352.701138:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.701151:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562352.701165:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562352.701169:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc7fb7800 from 7 10000000:01000000:1.0:1783562352.701173:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562352.701211:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.701233:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.701246:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562352.701272:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.701339:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.701382:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783562352.701566:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606272 00000100:00100000:3.0:1783562352.701576:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606272 00000100:00100000:3.0:1783562352.701694:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783562352.701718:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563606272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562352.701735:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562352.701755:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87eda expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.701785:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87eda expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.701801:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87eda expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.701813:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:3.0:1783562352.701882:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.701891:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783562352.702010:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562352.702030:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.702041:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562352.702116:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.702160:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.702196:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562352.702217:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606400 00000100:00100000:1.0:1783562352.702223:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606400 00000100:00100000:1.0:1783562352.702266:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783562352.702278:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.702946:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 667us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562352.702957:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783562352.703053:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.703112:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.703547:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562352.703642:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd8139f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562352.703706:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606528 00000100:00100000:1.0:1783562352.703713:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606528 00000100:00100000:1.0:1783562352.703823:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783562352.703836:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.704157:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562352.704170:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1783562352.704234:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562352.705232:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783562352.705561:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783562352.705592:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562352.705610:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.705626:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562352.705644:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783562352.705649:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc78df800 from 7 10000000:01000000:3.0:1783562352.705654:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783562352.705701:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.705715:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562352.705729:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562352.705765:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.705976:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562352.706086:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd00650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562352.706147:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606656 00000100:00100000:1.0:1783562352.706157:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606656 00000100:00100000:1.0:1783562352.706306:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783562352.706325:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563606656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562352.706343:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562352.706363:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b87ee8 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.706528:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.706548:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.706565:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499a00, rc 0) 00000100:00100000:1.0:1783562352.706645:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563606656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562352.706657:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783562352.706667:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562352.706689:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562352.706700:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562352.706773:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3eba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562352.706816:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562352.706840:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceed3acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562352.706852:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606784 00000100:00100000:1.0:1783562352.706859:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606784 00000100:00100000:1.0:1783562352.706967:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783562352.706984:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563606784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.707372:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563606784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562352.707384:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783562352.707634:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3eba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.707707:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562352.707794:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562352.707966:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc942d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783562352.708047:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563606912 00000100:00100000:3.0:1783562352.708059:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563606912 00000100:00100000:3.0:1783562352.708123:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783562352.708145:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563606912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562352.708652:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563606912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 512us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562352.708665:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783562352.708785:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563606912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783562352.710092:0:11074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783562352.710579:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783562352.710622:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562352.710637:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562352.710666:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562352.893713:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.893806:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091072 00000100:00100000:2.0:1783562352.893819:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091072 00000100:00100000:2.0:1783562352.893929:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:2.0:1783562352.893942:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:5573:x1870200553091072:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562352.893965:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562352.893991:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2115f expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.894031:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.894045:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.894056:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1cc00, rc 0) 00000100:00100000:2.0:1783562352.894115:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091072:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 176us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.894123:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:1.0:1783562352.897487:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.897556:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091200 00000100:00100000:2.0:1783562352.897570:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091200 00000100:00100000:2.0:1783562352.897636:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:2.0:1783562352.897649:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091200:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562352.898052:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091200:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 405us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.898068:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:0.0:1783562352.900395:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.900512:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091328 00000100:00100000:2.0:1783562352.900534:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091328 00000100:00100000:2.0:1783562352.900593:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:2.0:1783562352.900605:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091328:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562352.900873:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091328:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 269us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.900882:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:0.0:1783562352.903486:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.903553:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091456 00000100:00100000:2.0:1783562352.903693:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091456 00000100:00100000:2.0:1783562352.903750:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:2.0:1783562352.903764:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553091456:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562352.903780:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562352.903799:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21166 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.903833:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.903846:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562352.903857:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c600, rc 0) 00000100:00100000:2.0:1783562352.903920:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553091456:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 160us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.903929:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:1.0:1783562352.905105:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.905158:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091584 00000100:00100000:2.0:1783562352.905166:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091584 00000100:00100000:2.0:1783562352.905211:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 221 00000100:00100000:2.0:1783562352.905222:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553091584:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562352.905574:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553091584:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 354us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.905584:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 221 00000100:00100000:0.0:1783562352.907697:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562352.907953:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091712 00000100:00100000:2.0:1783562352.907963:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091712 00000100:00100000:2.0:1783562352.908017:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 222 00000100:00100000:2.0:1783562352.908030:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553091712:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562352.908287:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553091712:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 260us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562352.908304:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 222 00000001:02000400:1.0:1783562353.443961:0:11171:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783562353.590647:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562354.111035:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562354.111088:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562354.111129:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091840 00000100:00100000:2.0:1783562354.111152:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091840 00000100:00100000:0.0:1783562354.111186:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562354.111229:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562354.111304:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00100000:2.0:1783562354.111319:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553091840:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562354.111472:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553091840:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 156us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562354.111481:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00100000:1.0:1783562354.111857:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092352 00000100:00100000:1.0:1783562354.111864:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092352 00000100:00100000:1.0:1783562354.111927:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:1.0:1783562354.111938:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562354.111982:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562354.111991:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00080000:1.0:1783562354.112051:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562354.112102:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562354.112216:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092224 00000100:00100000:1.0:1783562354.112221:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092224 00000100:00100000:1.0:1783562354.112436:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:1.0:1783562354.112445:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562354.112496:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 52us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562354.112503:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00080000:1.0:1783562354.112642:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562354.114137:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092096 00000100:00100000:0.0:1783562354.114155:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553091968 00000100:00100000:3.0:1783562354.114158:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092096 00000100:00100000:0.0:1783562354.114159:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553091968 00000100:00080000:1.0:1783562354.114236:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562354.114909:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:3.0:1783562354.115108:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:3.0:1783562354.115118:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562354.115234:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2364:x1870200553092096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 117us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562354.115245:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:0.0:1783562354.115963:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553091968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562354.116022:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553091968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1103us (4791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562354.116030:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00010000:00010000:3.0:1783562354.614743:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562355.559901:0:11270:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:59:13 (1783562353) === 00010000:00010000:1.0:1783562355.639579:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562355.685734:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562355.687650:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092480 00000100:00100000:1.0:1783562355.687665:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092480 00000100:00100000:1.0:1783562355.687737:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562355.687750:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9659:x1870200553092480:12345-192.168.204.4@tcp:700:mkdir.0 00000100:00100000:1.0:1783562355.687855:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9659:x1870200553092480:12345-192.168.204.4@tcp:700:mkdir.0 Request processed in 107us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562355.687862:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562355.693581:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.693676:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092736 00000100:00100000:2.0:1783562355.693688:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092736 00000100:00100000:2.0:1783562355.693776:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562355.693806:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9659:x1870200553092736:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:2.0:1783562355.693880:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562355.693946:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87de5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210e8 expref: 6 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.693970:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89eab00) 00010000:00010000:2.0:1783562355.693984:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562355.694346:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.694362:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.694374:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.694473:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.694482:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.694490:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.695891:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783562355.695910:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.695923:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.695947:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.695955:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.695962:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.695972:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.695995:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37600) 00010000:00010000:2.0:1783562355.695999:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.696005:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.696013:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562355.696038:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c1db50e reply state 0000000054c89a95 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562355.696050:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562355.696182:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9659:x1870200553092736:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 2375us (2611us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783562355.696192:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00010000:00010000:1.0:1783562355.699160:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699182:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699190:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699194:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562355.699198:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699204:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699224:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562355.699227:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562355.699230:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.699235:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b87f0b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562355.705204:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.705650:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553092864 00000100:00100000:3.0:1783562355.705661:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553092864 00000100:00100000:3.0:1783562355.705726:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:3.0:1783562355.705737:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9660:x1870200553092864:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1783562355.705759:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562355.705784:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2116d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.705863:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.705879:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.705892:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562355.707105:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783562355.707115:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562355.707172:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.707216:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2116d expref: 8 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.707242:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2116d expref: 7 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.707253:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:3.0:1783562355.707256:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562355.707262:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:3.0:1783562355.707395:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9660:x1870200553092864:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1657us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562355.707443:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:0.0:1783562355.711678:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.711726:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553093120 00000100:00100000:3.0:1783562355.711741:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553093120 00000100:00100000:3.0:1783562355.711822:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:3.0:1783562355.712016:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9660:x1870200553093120:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1783562355.712201:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562355.712235:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2116d expref: 7 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.712260:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:3.0:1783562355.712275:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562355.712329:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.712344:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.712356:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783562355.713573:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef83d452 reply state 000000007e2c878b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562355.713591:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783562355.713613:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783562355.713747:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:9660:x1870200553093120:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 1905us (2070us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783562355.713757:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00010000:00010000:2.0:1783562355.715668:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715685:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715718:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715726:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.715731:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715740:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715760:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89eac00) 00010000:00010000:2.0:1783562355.715775:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783562355.715782:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.715789:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f20 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562355.736022:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.736110:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553093248 00000100:00100000:3.0:1783562355.736127:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553093248 00000100:00100000:3.0:1783562355.736211:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562355.736225:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9661:x1870200553093248:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1783562355.736265:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562355.736305:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21174 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736491:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736510:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736552:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562355.736661:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783562355.736665:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562355.736734:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736767:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21174 expref: 9 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736790:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21174 expref: 8 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.736799:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:3.0:1783562355.736802:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562355.736806:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336800, rc 0) 00000100:00100000:3.0:1783562355.736884:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:9661:x1870200553093248:12345-192.168.204.4@tcp:101:chown.0 Request processed in 664us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562355.736889:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:0.0:1783562355.739542:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.739668:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553093376 00000100:00100000:2.0:1783562355.739681:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553093376 00000100:00100000:2.0:1783562355.739798:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562355.739810:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:9661:x1870200553093376:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1783562355.739841:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562355.739886:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2117b expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.739986:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740003:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740026:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740045:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740053:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740059:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740222:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740231:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740240:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.740288:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783562355.740293:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562355.740325:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740340:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740348:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740368:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740375:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.740381:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740390:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740449:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:2.0:1783562355.740454:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.740469:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740477:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740500:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740506:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740512:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740517:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.740520:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740539:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740548:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bfcc4c37600) 00010000:00010000:2.0:1783562355.740551:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.740554:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740560:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740607:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2117b expref: 10 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740622:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2117b expref: 9 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.740629:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.740631:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562355.740634:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:2.0:1783562355.740710:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:9661:x1870200553093376:12345-192.168.204.4@tcp:101:chown.0 Request processed in 902us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.740718:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562355.743748:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.743837:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553093632 00000100:00100000:2.0:1783562355.743867:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553093632 00000100:00100000:2.0:1783562355.743961:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562355.743977:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:9661:x1870200553093632:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:2.0:1783562355.744060:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562355.744111:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2117b expref: 9 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.744136:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.744152:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562355.744185:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.744200:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.744211:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562355.766972:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1783562355.767035:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a6adeb5 reply state 000000002a35b28a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562355.767059:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783562355.767280:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783562355.767475:0:5756:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783562355.767573:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9661:x1870200553093632:12345-192.168.204.4@tcp:36:chown.0 Request processed in 23591us (23831us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783562355.767589:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00010000:00010000:1.0:1783562355.767699:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.767968:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.767981:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.767989:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562355.767995:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.768006:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.768034:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37a00) 00010000:00010000:1.0:1783562355.768038:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562355.768044:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.768051:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b87f51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562355.782732:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.782894:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553093760 00000100:00100000:3.0:1783562355.782911:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553093760 00000100:00100000:3.0:1783562355.783056:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:3.0:1783562355.783071:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9662:x1870200553093760:12345-192.168.204.4@tcp:101:touch.500 00010000:00010000:3.0:1783562355.783109:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562355.783138:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21182 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562355.785013:0:6572:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1777us 00010000:00010000:2.0:1783562355.794506:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.794549:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.794564:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.794592:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.794600:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.794608:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795684:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795698:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795707:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.795785:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562355.795790:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562355.795882:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795898:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795904:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795913:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795929:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.795935:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795944:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795961:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:2.0:1783562355.795964:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.795971:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795978:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.795994:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796000:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796006:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796011:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.796014:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796019:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796038:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bfcc4c37600) 00010000:00010000:2.0:1783562355.796040:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.796044:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796051:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796104:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b87f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21182 expref: 8 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796121:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21182 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.796129:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.796132:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783562355.796134:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c200, rc 0) 00000100:00100000:2.0:1783562355.796243:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9662:x1870200553093760:12345-192.168.204.4@tcp:101:touch.500 Request processed in 13175us (13532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.796254:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:0.0:1783562355.801789:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.801946:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094016 00000100:00100000:3.0:1783562355.801960:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094016 00000100:00100000:3.0:1783562355.802100:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:3.0:1783562355.802118:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9662:x1870200553094016:12345-192.168.204.4@tcp:101:touch.500 00010000:00010000:3.0:1783562355.802149:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562355.802187:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87f74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21189 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802718:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802739:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802765:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802785:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802792:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.802800:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783562355.803994:0:5754:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1783562355.804354:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804382:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804396:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804497:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804505:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804514:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804522:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562355.804527:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804537:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804554:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:3.0:1783562355.804557:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562355.804562:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804570:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b87f7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783562355.804584:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f0bc82e reply state 00000000348e1c83 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562355.804601:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783562355.804645:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87f74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21189 expref: 10 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804662:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21189 expref: 9 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.804670:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc89eae00) 00010000:00010000:3.0:1783562355.804672:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562355.804675:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:3.0:1783562355.804780:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:9662:x1870200553094016:12345-192.168.204.4@tcp:101:touch.500 Request processed in 2668us (3006us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783562355.804791:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00010000:00010000:2.0:1783562355.806351:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806375:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806384:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806456:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.806462:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806471:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806494:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bfcc89ea000) 00010000:00010000:2.0:1783562355.806497:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.806502:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.806509:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b87f82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562355.812255:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.812326:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094272 00000100:00100000:2.0:1783562355.812348:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094272 00000100:00100000:2.0:1783562355.812763:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:2.0:1783562355.812778:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:9662:x1870200553094272:12345-192.168.204.4@tcp:36:touch.500 00010000:00010000:2.0:1783562355.812871:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562355.812916:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b87f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21189 expref: 9 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.812941:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc89eae00) 00010000:00010000:2.0:1783562355.812958:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562355.813030:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.813046:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.813073:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562355.813281:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a68a401 reply state 000000002c8f4070 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562355.813292:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562355.813459:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:9662:x1870200553094272:12345-192.168.204.4@tcp:36:touch.500 Request processed in 685us (1222us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783562355.813474:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00010000:00010000:1.0:1783562355.817847:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817906:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817915:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817926:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562355.817933:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817941:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817964:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc4c37600) 00010000:00010000:1.0:1783562355.817967:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562355.817973:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.817980:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b87f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562355.818133:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.818587:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094400 00000100:00100000:2.0:1783562355.818601:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094400 00000100:00100000:2.0:1783562355.818683:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:2.0:1783562355.818698:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:9662:x1870200553094400:12345-192.168.204.4@tcp:101:touch.500 00010000:00010000:2.0:1783562355.818734:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562355.818765:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21190 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.818852:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21190 expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.818870:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21190 expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.818895:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562355.818898:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562355.818903:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:2.0:1783562355.819589:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:9662:x1870200553094400:12345-192.168.204.4@tcp:101:touch.500 Request processed in 890us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.819600:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:1.0:1783562355.822852:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.822941:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094528 00000100:00100000:3.0:1783562355.822961:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094528 00000100:00100000:3.0:1783562355.823031:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:3.0:1783562355.823042:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1870200553094528:12345-192.168.204.4@tcp:8:touch.500 00010000:00080000:3.0:1783562355.823089:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:3.0:1783562355.823136:0:6608:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b87fa5 00002000:00100000:3.0:1783562355.823151:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aeded353-5c04-404d-8ca0-d71cfbeced3d/ffff9bfcc7e26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783562355.823175:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783562355.823533:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783562355.823573:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e25800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562355.823648:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553094528:12345-192.168.204.4@tcp:8:touch.500 Request processed in 606us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562355.823678:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:0.0:1783562355.827189:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.827364:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094656 00000100:00100000:2.0:1783562355.827377:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094656 00000100:00080000:1.0:1783562355.827470:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562355.827553:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562355.827567:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:0:x1870200553094656:12345-192.168.204.4@tcp:2:touch.500 00000001:00080000:3.0:1783562355.850101:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1783562355.850139:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000100:00100000:0.0:1783562355.850387:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:0:x1870200553094656:12345-192.168.204.4@tcp:2:touch.500 Request processed in 22817us (23214us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783562355.850470:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:0.0:1783562355.856876:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.857097:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553094912 00000100:00100000:2.0:1783562355.857108:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553094912 00000100:00100000:2.0:1783562355.857241:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:2.0:1783562355.857255:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:9662:x1870200553094912:12345-192.168.204.4@tcp:35:touch.500 00000100:00100000:2.0:1783562355.857918:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:9662:x1870200553094912:12345-192.168.204.4@tcp:35:touch.500 Request processed in 584us (979us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783562355.857930:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:1.0:1783562355.869134:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.869330:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553095040 00000100:00100000:3.0:1783562355.869345:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553095040 00000100:00100000:3.0:1783562355.869485:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:3.0:1783562355.869498:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:9663:x1870200553095040:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1783562355.869584:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562355.869613:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21197 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.869695:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.869713:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.869729:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.869897:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562355.869920:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562355.870041:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.870075:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21197 expref: 13 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.870096:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21197 expref: 12 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.870106:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.870109:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562355.870113:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c800, rc 0) 00000100:00100000:2.0:1783562355.870186:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:9663:x1870200553095040:12345-192.168.204.4@tcp:101:rm.0 Request processed in 690us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.870194:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:0.0:1783562355.873561:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.873827:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553095296 00000100:00100000:2.0:1783562355.873839:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553095296 00000100:00100000:2.0:1783562355.873919:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:2.0:1783562355.873941:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:9663:x1870200553095296:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1783562355.873965:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562355.873989:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b87fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2119e expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.874126:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783562355.874309:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b87fba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2119e expref: 14 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.874325:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:2.0:1783562355.874336:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562355.874343:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b87fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2119e expref: 14 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.874359:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1de00, rc 0) 00000100:00100000:2.0:1783562355.874498:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:9663:x1870200553095296:12345-192.168.204.4@tcp:101:rm.0 Request processed in 568us (951us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783562355.874507:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:1.0:1783562355.880462:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.882257:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553095424 00000100:00100000:2.0:1783562355.882284:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553095424 00000100:00100000:2.0:1783562355.882499:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:2.0:1783562355.882514:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:9663:x1870200553095424:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:2.0:1783562355.886459:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:9663:x1870200553095424:12345-192.168.204.4@tcp:37:rm.0 Request processed in 3894us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.886480:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:1.0:1783562355.889735:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562355.890493:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553095680 00000100:00100000:0.0:1783562355.890509:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553095680 00000100:00100000:0.0:1783562355.890590:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:0.0:1783562355.890603:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5078050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:9663:x1870200553095680:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:0.0:1783562355.891003:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5078050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:9663:x1870200553095680:12345-192.168.204.4@tcp:35:rm.0 Request processed in 402us (1281us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783562355.891012:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562355.893795:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.893878:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553095936 00000100:00100000:2.0:1783562355.893890:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553095936 00000100:00100000:2.0:1783562355.893969:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562355.893980:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:9663:x1870200553095936:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1783562355.894011:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562355.894039:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b87fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211a5 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.894207:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.894225:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.894272:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.894288:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783562355.894578:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b87fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211a5 expref: 17 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.894607:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211a5 expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.894617:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.894620:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562355.894624:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ce00, rc 0) 00000100:00100000:2.0:1783562355.894719:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553095936:12345-192.168.204.4@tcp:101:rm.0 Request processed in 740us (935us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783562355.894728:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:1.0:1783562355.898867:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.899015:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553096064 00000100:00100000:2.0:1783562355.899028:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553096064 00000100:00100000:2.0:1783562355.899100:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:2.0:1783562355.899114:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096064:12345-192.168.204.4@tcp:41:rm.0 00000004:00000024:2.0:1783562355.899205:0:5756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1783562355.899372:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096064:12345-192.168.204.4@tcp:41:rm.0 Request processed in 260us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562355.899380:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562355.901951:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562355.902227:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553096192 00000100:00100000:0.0:1783562355.902251:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553096192 00000100:00100000:0.0:1783562355.902312:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562355.902319:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096192:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1783562355.902341:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562355.902364:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b87fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211ac expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902488:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902507:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902523:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902542:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902566:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902574:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902728:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902738:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902745:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562355.902789:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783562355.902794:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562355.902815:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902828:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902836:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902843:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902850:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902867:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562355.902873:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902882:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902897:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:0.0:1783562355.902901:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562355.902908:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902914:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b87fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902931:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902938:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902943:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902948:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562355.902951:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902957:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902976:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bfce234ea00) 00010000:00010000:0.0:1783562355.902978:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562355.902981:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.902988:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b87feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.903029:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b87fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ac expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.903047:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ac expref: 17 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.903053:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562355.903056:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562355.903058:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562355.903138:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:9663:x1870200553096192:12345-192.168.204.4@tcp:101:rm.0 Request processed in 817us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562355.903147:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:1.0:1783562355.906680:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562355.906888:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553096448 00000100:00100000:3.0:1783562355.906903:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553096448 00000100:00100000:3.0:1783562355.906989:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:3.0:1783562355.907002:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:9663:x1870200553096448:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1783562355.907093:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783562355.907231:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b87ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ac expref: 17 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907257:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b87f9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21190 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907269:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562355.907286:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b87fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21197 expref: 15 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907292:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:3.0:1783562355.907294:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562355.907321:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907344:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907353:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907367:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907372:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907376:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907701:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907711:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.907719:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562355.908746:0:5754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1783562355.908762:0:5754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 165165358902ns, next at 166165355631ns, rc = 0 00010000:00010000:3.0:1783562355.908853:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.908867:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.908890:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.908899:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.908907:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.908912:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909003:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562355.909049:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909056:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909062:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909069:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562355.909074:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909082:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909098:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc89ea900) 00010000:00010000:3.0:1783562355.909101:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783562355.909123:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909130:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88007 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909160:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909167:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909174:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909180:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562355.909183:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909189:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909198:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:3.0:1783562355.909200:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562355.909204:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.909211:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b87ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783562355.909223:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006b91ab0 reply state 0000000005c6dbaf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562355.909245:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783562355.909398:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096448:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2393us (2729us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783562355.909438:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00010000:00010000:0.0:1783562355.909596:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562355.909608:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.909615:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562355.909619:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.909636:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.909646:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bfcc89ea900) 00010000:00010000:0.0:1783562355.909648:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783562355.909652:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.909659:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8800e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562355.909705:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562355.909707:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562355.909709:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562355.911286:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911306:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911314:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911320:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562355.911325:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911332:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911347:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bfcc89ea400) 00010000:00010000:3.0:1783562355.911349:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562355.911353:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562355.911359:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b88000 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562355.913974:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.914287:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553096704 00000100:00100000:2.0:1783562355.914301:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553096704 00000100:00100000:2.0:1783562355.914497:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:2.0:1783562355.914514:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:9663:x1870200553096704:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:2.0:1783562355.915029:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096704:12345-192.168.204.4@tcp:35:rm.0 Request processed in 519us (1066us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783562355.915039:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562355.917612:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562355.917857:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553096960 00000100:00100000:2.0:1783562355.917871:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553096960 00000100:00100000:2.0:1783562355.918091:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562355.918107:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:9663:x1870200553096960:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1783562355.918253:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783562355.918294:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b87fcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211a5 expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918323:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c200/0x4738ba0933b87f6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21182 expref: 15 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918337:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37b00) 00010000:00010000:2.0:1783562355.918360:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b87f2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21174 expref: 14 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918474:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc89ea300) 00010000:00010000:2.0:1783562355.918486:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562355.918514:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918530:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918565:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918582:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918591:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918598:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.918979:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.920236:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.920252:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562355.921460:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783562355.921484:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921493:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921500:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921507:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.921520:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921527:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921541:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562355.921543:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783562355.921547:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921552:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88023 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921575:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921579:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921582:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921585:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1de00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562355.921587:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921590:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921594:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37e00) 00010000:00010000:2.0:1783562355.921596:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562355.921601:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562355.921605:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b88015 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562355.921613:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbdf42e3 reply state 0000000070aa1b6e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562355.921620:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562355.921739:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:9663:x1870200553096960:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3629us (4134us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783562355.921749:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00010000:00010000:1.0:1783562355.925539:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925575:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925583:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925590:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562355.925596:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925604:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925625:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bfcc4c37c00) 00010000:00010000:1.0:1783562355.925628:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562355.925633:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562355.925639:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b8801c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562356.664738:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562357.111135:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563607296:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.111256:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562357.111314:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563607168:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.111460:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607296 00000100:00100000:0.0:1783562357.111477:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607296 00000100:00100000:3.0:1783562357.111521:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562357.111580:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607168 00000100:00100000:0.0:1783562357.111586:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607168 00000100:00100000:3.0:1783562357.111589:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783562357.111603:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563607040:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.111632:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783562357.111656:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563607296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562357.111658:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562357.111739:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783562357.111761:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563607168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.111773:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563607296:12345-0@lo:400:kworker.0 Request processed in 126us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562357.111797:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783562357.111856:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563607168:12345-0@lo:400:kworker.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562357.111869:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783562357.111894:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563607296:0@lo:400:kworker.0 00000100:00100000:3.0:1783562357.111946:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563607168:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.111984:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607424:0@lo:400:kworker.0 00000100:00100000:3.0:1783562357.112026:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607040 00000100:00100000:3.0:1783562357.112037:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607040 00000100:00100000:0.0:1783562357.112045:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562357.112101:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783562357.112117:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563607040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.112141:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562357.112155:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563607552:0@lo:400:kworker.0 00000100:00100000:3.0:1783562357.112176:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563607040:12345-0@lo:400:kworker.0 Request processed in 61us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562357.112203:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562357.112236:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563607040:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.112261:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607552 00000100:00100000:0.0:1783562357.112265:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607552 00000100:00100000:0.0:1783562357.112298:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783562357.112304:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563607552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.112342:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563607552:12345-0@lo:400:kworker.0 Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562357.112349:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1783562357.112380:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562357.112381:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563607552:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.112465:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563607680:0@lo:400:kworker.0 00000100:00100000:1.0:1783562357.112471:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607424 00000100:00100000:1.0:1783562357.112477:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607424 00000100:00100000:0.0:1783562357.112503:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562357.112523:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607680 00000100:00100000:1.0:1783562357.112527:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607680 00000100:00100000:1.0:1783562357.112550:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783562357.112566:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783562357.112572:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783562357.112580:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562357.112587:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783562357.112627:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607424:12345-0@lo:400:kworker.0 Request processed in 58us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562357.112639:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783562357.112661:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783562357.112673:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563607680:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783562357.112722:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6543100 x1870200563607424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562357.112730:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563607680:12345-0@lo:400:kworker.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562357.112758:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783562357.112759:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6540380 x1870200563607680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562357.112764:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607424:0@lo:400:kworker.0 00000100:00100000:0.0:1783562357.112792:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563607680:0@lo:400:kworker.0 00000004:00080000:3.0:1783562357.623371:0:7881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 166879962427ns, next at 167879958757ns, rc = 0 00000100:00100000:3.0:1783562357.623447:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562357.623553:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562357.623597:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607936 00000100:00100000:0.0:1783562357.623607:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607936 00000100:00100000:3.0:1783562357.623626:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783562357.623659:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562357.623672:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783562357.623685:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607936:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562357.623692:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783562357.623727:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562357.623734:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563607808 00000100:00100000:3.0:1783562357.623741:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563607808 00000100:00100000:3.0:1783562357.623779:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783562357.623787:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562357.623802:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562357.623844:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562357.623852:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783562357.623901:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6522d80 x1870200563607808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562357.623923:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607808:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783562357.623935:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6540380 x1870200563607936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562357.623946:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563607936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562357.624009:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563607936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562357.624020:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783562357.686705:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562358.434467:0:11421:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1783562358.711958:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562359.148507:0:11469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe1529290 20000000:00000080:3.0:1783562359.148539:0:11469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcc588e000 uarg=0000000000000000 20000000:01000000:3.0:1783562359.148594:0:11469:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783562359.148604:0:11469:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783562359.148610:0:11469:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783562359.149568:0:11470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783562359.149805:0:11469:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783562359.154711:0:11469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783562359.154769:0:11469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783562359.154825:0:11469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783562359.154849:0:11469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783562359.155540:0:11469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155567:0:11469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155576:0:11469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87eda expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155584:0:11469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155598:0:11469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155606:0:11469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155615:0:11469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155668:0:11469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155689:0:11469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 12 pid: 5749 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.155707:0:11469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608064:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562359.155908:0:11469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155931:0:11469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 12 pid: 5750 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.155940:0:11469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608192:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562359.155975:0:11469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.155982:0:11469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 18 pid: 5749 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.155992:0:11469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608320:0@lo:104: 00000100:00100000:3.0:1783562359.156036:0:11469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562359.156072:0:11469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.156080:0:11469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 18 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.156088:0:11469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608448:0@lo:104: 00000100:00100000:3.0:1783562359.156108:0:11469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783562359.156129:0:11469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.156204:0:11469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 18 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.156225:0:11469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608576:0@lo:104: 00000100:00100000:3.0:1783562359.156264:0:11469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562359.156283:0:11469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562359.156544:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608320 00000100:00100000:3.0:1783562359.156553:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608320 00000100:00100000:3.0:1783562359.156603:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608448 00000100:00100000:3.0:1783562359.156606:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608448 00000100:00100000:3.0:1783562359.156617:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608576 00000100:00100000:3.0:1783562359.156619:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608576 00000100:00100000:3.0:1783562359.156632:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562359.156640:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:11469:x1870200563608320:12345-0@lo:104: 00010000:00010000:3.0:1783562359.156653:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.156721:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783562359.156729:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+5:11469:x1870200563608320:12345-0@lo:104: Request processed in 89us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562359.156736:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783562359.156748:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783562359.156759:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:11469:x1870200563608448:12345-0@lo:104: 00010000:00010000:2.0:1783562359.156769:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.156817:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783562359.156822:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+4:11469:x1870200563608448:12345-0@lo:104: Request processed in 67us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562359.156828:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783562359.156841:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783562359.156847:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:11469:x1870200563608576:12345-0@lo:104: 00010000:00010000:2.0:1783562359.156854:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.156886:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783562359.156891:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+3:11469:x1870200563608576:12345-0@lo:104: Request processed in 46us (628us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562359.156896:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562359.156903:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562359.156903:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1783562359.156911:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336600 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562359.156917:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.156917:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562359.156922:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.156927:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.156929:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562359.156932:0:8323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562359.156935:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.156938:0:8323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562359.156941:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1783562359.156944:0:8323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562359.156949:0:8323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783562359.156981:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.156988:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562359.157010:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157016:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b87ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87eef expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157028:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562359.157031:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157037:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562359.157039:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157045:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562359.157051:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562359.157056:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783562359.157341:0:8323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.157347:0:8323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562359.157364:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.157371:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b87eda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ee1 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.157383:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562359.157385:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562359.157387:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562359.157479:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157486:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562359.157504:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157522:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b87ecc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b87ed3 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157538:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562359.157540:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562359.157542:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562359.157558:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563608704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562359.157598:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562359.157638:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562359.157645:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563608832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562359.157645:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562359.157661:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563608960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562359.157669:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562359.157691:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562359.157695:0:11469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608320:0@lo:104: 00000100:00100000:3.0:1783562359.157711:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608704 00000100:00100000:3.0:1783562359.157717:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608704 00000100:00100000:0.0:1783562359.157718:0:11469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608448:0@lo:104: 00000100:00100000:2.0:1783562359.157725:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608832 00000100:00100000:2.0:1783562359.157730:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608832 00000100:00100000:0.0:1783562359.157733:0:11469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608576:0@lo:104: 00010000:00010000:3.0:1783562359.157743:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 20 pid: 5749 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.157747:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 20 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562359.157767:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563608960 00000100:00100000:2.0:1783562359.157770:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563608960 00000100:00100000:3.0:1783562359.157776:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1783562359.157783:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 21 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562359.157786:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783562359.157787:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+21:3274:x1870200563608704:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562359.157802:0:5741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1783562359.157804:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783562359.157805:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+21:3274:x1870200563608832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562359.157812:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 21 pid: 5749 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562359.157813:0:5741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1783562359.157821:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562359.157824:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 21 pid: 5749 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.157831:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 21 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.157848:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1499a00/0x4738ba0933b87eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87ee8 expref: 21 pid: 5749 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.157859:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 21 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.157878:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337c00/0x4738ba0933b87ee1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87eda expref: 21 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.157898:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562359.157942:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3274:x1870200563608832:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562359.157950:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783562359.157969:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783562359.157976:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563608960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562359.157985:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562359.157997:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 19 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.158007:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 19 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.158016:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337400/0x4738ba0933b87ed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b87ecc expref: 19 pid: 5750 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.158023:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562359.158086:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3272:x1870200563608960:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562359.158139:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1783562359.158171:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562359.158199:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563608704:12345-0@lo:103:ldlm_bl.0 Request processed in 416us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562359.158205:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783562359.158311:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563608832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562359.158320:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563608704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562359.158482:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563608960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562359.160316:0:11469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608064:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562359.160329:0:11469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11469:1870200563608192:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562359.160396:0:11469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562359.160814:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562359.160837:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562359.160910:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097088 00000100:00100000:3.0:1783562359.160911:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097216 00000100:00100000:3.0:1783562359.160921:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097216 00000100:00100000:2.0:1783562359.160921:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097088 00010000:00010000:3.0:1783562359.160960:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 14 pid: 5749 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562359.160960:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 14 pid: 5750 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.161000:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562359.161008:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+14:2363:x1870200553097216:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562359.161022:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562359.161028:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 14 pid: 5749 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.161039:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 14 pid: 5749 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.161057:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1c600/0x4738ba0933b87efd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21166 expref: 14 pid: 5749 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562359.161065:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00010000:00010000:3.0:1783562359.161071:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562359.161080:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553097088:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562359.161092:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562359.161099:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 13 pid: 5750 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161110:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 13 pid: 5750 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.161127:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2363:x1870200553097216:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 118us (286us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562359.161146:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b87ef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2115f expref: 13 pid: 5750 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562359.161150:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00010000:00010000:0.0:1783562359.161166:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161175:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161191:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161195:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161201:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161206:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161210:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562359.161215:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161222:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161240:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.161250:0:11469:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.161269:0:11469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562359.161274:0:11469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336c00/0x4738ba0933b8802a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562359.161275:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562359.161323:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+11:2364:x1870200553097088:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 239us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562359.161331:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562359.230740:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562359.230803:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562359.230806:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097344 00000100:00100000:1.0:1783562359.230822:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097344 00000100:00100000:3.0:1783562359.230853:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097600 00000100:00100000:0.0:1783562359.230861:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562359.230869:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097600 00000100:00100000:0.0:1783562359.230908:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097472 00000100:00100000:0.0:1783562359.230918:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097472 00000100:00100000:1.0:1783562359.230936:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:3.0:1783562359.230951:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:1.0:1783562359.230963:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2362:x1870200553097344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562359.230976:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553097600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562359.230987:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:0.0:1783562359.231002:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553097472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562359.231127:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553097600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 155us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562359.231130:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2362:x1870200553097344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562359.231158:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:1.0:1783562359.231171:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00080000:1.0:1783562359.231219:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783562359.231226:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562359.233094:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553097472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2082us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562359.233110:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:0.0:1783562359.236555:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562359.236641:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097728 00000100:00100000:3.0:1783562359.236669:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097728 00000100:00080000:1.0:1783562359.236763:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562359.236804:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:3.0:1783562359.236828:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2360:x1870200553097728:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:3.0:1783562359.236893:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87eb7 00000100:00080000:3.0:1783562359.236911:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3a8000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783562359.236969:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783562359.236989:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783562359.238527:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562359.238612:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097856 00000100:00100000:0.0:1783562359.238628:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097856 00000100:00100000:0.0:1783562359.238755:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00080000:1.0:1783562359.238765:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562359.238777:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2360:x1870200553097856:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:0.0:1783562359.238830:0:6549:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87ebe 00000100:00080000:0.0:1783562359.238842:0:6549:0:(import.c:65:import_set_state_nolock()) ffff9bfcef657000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783562359.238894:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783562359.238905:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783562359.238989:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+2:2360:x1870200553097728:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 2161us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562359.239006:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:0.0:1783562359.239314:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+2:2360:x1870200553097856:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 542us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562359.239325:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00010000:00010000:3.0:1783562359.735642:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562360.447308:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562360.447474:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553097984 00000100:00100000:2.0:1783562360.447488:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553097984 00000100:00100000:2.0:1783562360.447563:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:2.0:1783562360.447574:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+11:5573:x1870200553097984:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562360.447602:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562360.447633:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1c200/0x4738ba0933b88031 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211b3 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.447689:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1c200/0x4738ba0933b88031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211b3 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.447732:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1c200/0x4738ba0933b88031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211b3 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.447742:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c200, rc 0) 00000100:00100000:2.0:1783562360.447815:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553097984:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 243us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.447823:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:1.0:1783562360.451276:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562360.451484:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098112 00000100:00100000:3.0:1783562360.451500:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098112 00000100:00100000:3.0:1783562360.451590:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 226 00000100:00100000:3.0:1783562360.451604:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553098112:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562360.452682:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553098112:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 496us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562360.452696:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 226 00000100:00100000:1.0:1783562360.458499:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562360.458620:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098240 00000100:00100000:0.0:1783562360.458635:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098240 00000100:00100000:0.0:1783562360.458717:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:0.0:1783562360.458729:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553098240:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562360.459197:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553098240:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 470us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.459203:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:1.0:1783562360.465908:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562360.466699:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098368 00000100:00100000:2.0:1783562360.466718:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098368 00000100:00100000:2.0:1783562360.466817:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 228 00000100:00100000:2.0:1783562360.466834:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:9933:x1870200553098368:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562360.467290:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+12:9933:x1870200553098368:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 460us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.467302:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 228 00000100:00100000:1.0:1783562360.476145:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562360.476235:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098496 00000100:00100000:0.0:1783562360.476253:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098496 00000100:00100000:0.0:1783562360.476462:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:0.0:1783562360.476485:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+12:9933:x1870200553098496:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562360.477751:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+12:9933:x1870200553098496:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 1267us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.477764:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:0.0:1783562360.484087:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562360.484231:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098624 00000100:00100000:1.0:1783562360.484247:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098624 00000100:00100000:1.0:1783562360.484345:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 230 00000100:00100000:1.0:1783562360.484360:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+12:5573:x1870200553098624:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562360.484394:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562360.484466:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1498a00/0x4738ba0933b88038 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211ba expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.484516:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1498a00/0x4738ba0933b88038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ba expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.484532:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1498a00/0x4738ba0933b88038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ba expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.484543:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498a00, rc 0) 00000100:00100000:1.0:1783562360.484636:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553098624:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 280us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562360.484648:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 230 00000100:00100000:1.0:1783562360.491088:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562360.491170:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098752 00000100:00100000:0.0:1783562360.491184:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098752 00000100:00100000:0.0:1783562360.491265:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:0.0:1783562360.491277:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553098752:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562360.491781:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553098752:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 504us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.491792:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:0.0:1783562360.497886:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562360.501892:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553098880 00000100:00100000:2.0:1783562360.501927:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553098880 00000100:00100000:2.0:1783562360.502044:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 232 00000100:00100000:2.0:1783562360.502059:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553098880:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562360.502653:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:5573:x1870200553098880:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 591us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.502667:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 232 00000100:00100000:1.0:1783562360.517393:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562360.517827:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099008 00000100:00100000:0.0:1783562360.517862:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099008 00000100:00100000:0.0:1783562360.517976:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 233 00000100:00100000:0.0:1783562360.518023:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:9936:x1870200553099008:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562360.518905:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:9936:x1870200553099008:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 880us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.518914:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 233 00000100:00100000:3.0:1783562360.524231:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562360.526361:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099136 00000100:00100000:2.0:1783562360.526390:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099136 00000100:00100000:2.0:1783562360.526559:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 234 00000100:00100000:2.0:1783562360.526574:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:9936:x1870200553099136:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562360.527034:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:9936:x1870200553099136:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 462us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.527044:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 234 10000000:01000000:1.0:1783562360.566484:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562360.566502:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfceec04800 from 7 10000000:01000000:1.0:1783562360.566510:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562360.566585:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.566619:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.566631:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562360.566661:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.566755:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.566898:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562360.566955:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609088 00000100:00100000:2.0:1783562360.566965:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609088 00000100:00100000:2.0:1783562360.567036:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783562360.567046:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:5752:x1870200563609088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562360.567065:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562360.567081:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b88046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8803f expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.567109:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b88046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8803f expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.567119:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b88046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8803f expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.567130:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1de00, rc 0) 00000100:00100000:2.0:1783562360.567223:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.567231:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783562360.567425:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562360.567443:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.567453:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562360.567939:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.567973:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.568014:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218840 going to sleep for 11 seconds 00000100:00100000:0.0:1783562360.568084:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609216 00000100:00100000:0.0:1783562360.568091:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609216 00000100:00100000:0.0:1783562360.568169:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783562360.568178:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562360.568632:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 453us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.568640:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783562360.568721:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.568758:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.568821:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562360.568980:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609344 00000100:00100000:2.0:1783562360.568988:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609344 00000100:00100000:1.0:1783562360.568998:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562360.569019:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783562360.569033:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562360.569646:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 612us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.569666:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783562360.569677:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.570126:0:11483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11483:1870200563609472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.570171:0:11483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.570242:0:11483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562360.570283:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609472 00000100:00100000:3.0:1783562360.570289:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609472 00000100:00100000:3.0:1783562360.570369:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783562360.570379:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:11483:x1870200563609472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562360.570876:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:11483:x1870200563609472:12345-0@lo:502:llog_process_th.0 Request processed in 497us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562360.570884:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783562360.570995:0:11483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11483:1870200563609472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562360.571025:0:11483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562360.571039:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562360.571041:0:11483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783562360.571053:0:11483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfceec04800 00000020:00000080:1.0:1783562360.571056:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783562360.571158:0:11483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11483:1870200563609600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.571198:0:11483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.571271:0:11483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562360.572436:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609600 00000100:00100000:3.0:1783562360.572454:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609600 00000100:00100000:3.0:1783562360.572531:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783562360.572542:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:11483:x1870200563609600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562360.572838:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:11483:x1870200563609600:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562360.572860:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783562360.573192:0:11483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11483:1870200563609600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562360.573234:0:11483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562360.573248:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562360.573251:0:11483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783562360.573260:0:11483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783562360.573530:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783562360.573552:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562360.573569:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562360.573590:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562360.573604:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783562360.573607:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc7fb7800 from 7 10000000:01000000:3.0:1783562360.573611:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783562360.573654:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562360.573663:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562360.573673:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562360.573709:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783562360.573757:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562360.573801:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783562360.573974:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609728 00000100:00100000:0.0:1783562360.573982:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609728 00000100:00100000:0.0:1783562360.574029:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783562360.574039:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:5752:x1870200563609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562360.574054:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562360.574073:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8000/0x4738ba0933b88054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8804d expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562360.574103:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8000/0x4738ba0933b88054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8804d expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562360.574116:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8000/0x4738ba0933b88054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8804d expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562360.574128:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8000, rc 0) 00000100:00100000:0.0:1783562360.574779:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 726us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.574797:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783562360.575724:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562360.575750:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.575762:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562360.575990:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.576045:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.576093:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562360.576116:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609856 00000100:00100000:0.0:1783562360.576124:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609856 00000100:00100000:0.0:1783562360.576174:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783562360.576185:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563609856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562360.576591:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563609856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.576598:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783562360.576663:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.577042:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.577089:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.577124:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562360.577576:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563609984 00000100:00100000:3.0:1783562360.577586:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563609984 00000100:00100000:3.0:1783562360.577628:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783562360.577638:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563609984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562360.577883:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563609984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562360.577892:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783562360.577999:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562360.578231:0:11486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11486:1870200563610112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562360.578274:0:11486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562360.578400:0:11486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783562360.578464:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610112 00000100:00100000:0.0:1783562360.578469:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610112 00000100:00100000:0.0:1783562360.578531:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783562360.578539:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:11486:x1870200563610112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562360.578707:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:11486:x1870200563610112:12345-0@lo:502:llog_process_th.0 Request processed in 168us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562360.578715:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783562360.578834:0:11486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11486:1870200563610112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562360.578863:0:11486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562360.578878:0:11486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562360.578881:0:11486:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783562360.578889:0:11486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcc7fb7800 00000020:00000080:2.0:1783562360.578893:0:11486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783562360.579030:0:11486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11486:1870200563610240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562360.579068:0:11486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562360.579098:0:11486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562360.579142:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610240 00000100:00100000:1.0:1783562360.579146:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610240 00000100:00100000:1.0:1783562360.579181:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783562360.579188:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:11486:x1870200563610240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.579318:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:11486:x1870200563610240:12345-0@lo:502:llog_process_th.0 Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562360.579338:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783562360.579443:0:11486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11486:1870200563610240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562360.579463:0:11486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562360.579469:0:11486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562360.579471:0:11486:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783562360.579475:0:11486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783562360.579665:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783562360.579689:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562360.579702:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.579718:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562360.579731:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562360.579735:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc78df800 from 7 10000000:01000000:1.0:1783562360.579738:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562360.579770:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.579780:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.579803:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562360.579817:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.579852:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.579882:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218240 going to sleep for 11 seconds 00000100:00100000:2.0:1783562360.579925:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610368 00000100:00100000:2.0:1783562360.579930:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610368 00000100:00100000:2.0:1783562360.579965:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783562360.579974:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:5752:x1870200563610368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562360.579986:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562360.580004:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1d400/0x4738ba0933b88062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8805b expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.580045:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1d400/0x4738ba0933b88062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8805b expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.580058:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1d400/0x4738ba0933b88062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8805b expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562360.580071:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d400, rc 0) 00000100:00100000:2.0:1783562360.580104:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563610368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.580112:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783562360.580171:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562360.580184:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562360.580195:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562360.580243:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.580269:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.580289:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562360.580302:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610496 00000100:00100000:1.0:1783562360.580306:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610496 00000100:00100000:1.0:1783562360.580340:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783562360.580348:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563610496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.580707:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563610496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562360.580715:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783562360.580738:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.580768:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.580808:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.580817:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562360.580831:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610624 00000100:00100000:1.0:1783562360.580835:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610624 00000100:00100000:1.0:1783562360.580851:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783562360.580857:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563610624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.581018:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc78a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:5752:x1870200563610624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562360.581026:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783562360.581064:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:5752:1870200563610624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562360.581300:0:11487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11487:1870200563610752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.581345:0:11487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.581364:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610752 00000100:00100000:1.0:1783562360.581368:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610752 00000100:00100000:1.0:1783562360.581391:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783562360.581399:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:11487:x1870200563610752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.581599:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:11487:x1870200563610752:12345-0@lo:502:llog_process_th.0 Request processed in 199us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562360.581607:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783562360.581637:0:11487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562360.581649:0:11487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11487:1870200563610752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562360.581674:0:11487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562360.581689:0:11487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562360.581693:0:11487:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783562360.581708:0:11487:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcc78df800 00000020:00000080:1.0:1783562360.581717:0:11487:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783562360.582992:0:11487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11487:1870200563610880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562360.583053:0:11487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562360.583132:0:11487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62180c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562360.583218:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563610880 00000100:00100000:2.0:1783562360.583227:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563610880 00000100:00100000:2.0:1783562360.583309:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783562360.583320:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:11487:x1870200563610880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562360.583615:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc30b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:11487:x1870200563610880:12345-0@lo:502:llog_process_th.0 Request processed in 296us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562360.583623:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783562360.583710:0:11487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:11487:1870200563610880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562360.583738:0:11487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562360.583746:0:11487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562360.583749:0:11487:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783562360.583756:0:11487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783562360.583919:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783562360.583937:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562360.583949:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562360.583963:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562360.594013:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783562360.759520:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783562361.248871:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1783562361.248912:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1783562361.248952:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1783562361.248992:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783562361.249481:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563611008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783562361.249676:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562361.249796:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611008 00000100:00100000:0.0:1783562361.249811:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611008 00000100:00080000:2.0:1783562361.250780:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562361.250823:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783562361.250843:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563611008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783562361.250889:0:6550:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1783562361.250948:0:6550:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4f0072, atime: 0x6a4f0072, ctime: 0x6a4f0072, blocks: 0x1 00010000:00010000:0.0:1783562361.250960:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562361.250984:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=170s v=(0 0) 00010000:00010000:0.0:1783562361.250990:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562361.251000:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562361.251028:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562361.251039:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562361.251066:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562361.251107:0:6550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562361.251259:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562361.251277:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562361.251294:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562361.251301:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562361.251332:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562361.251355:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783562361.251363:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00010000:00010000:2.0:1783562361.251364:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b88069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783562361.251372:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfcef655800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00010000:00010000:2.0:1783562361.251389:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562361.251393:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562361.251395:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562361.251476:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef655800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 for lustre-OST0001 00000020:00000080:3.0:1783562361.251555:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef657000 for lustre-OST0001 00000100:00100000:0.0:1783562361.253471:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563611008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2625us (3786us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783562361.253490:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1783562361.253666:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf6741f80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1783562361.253675:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563611008:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1783562361.655174:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783562361.782748:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562362.231354:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563611136:0@lo:400:kworker.0 00000100:00100000:1.0:1783562362.231359:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563611264:0@lo:400:kworker.0 00000100:00100000:0.0:1783562362.231380:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563611520:0@lo:400:kworker.0 00000100:00100000:3.0:1783562362.231385:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563611392:0@lo:400:kworker.0 00000100:00100000:3.0:1783562362.231482:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562362.231485:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562362.231487:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562362.231559:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563611648:0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.231586:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562362.231605:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562362.231611:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563611776:0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.231634:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562362.231661:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611136 00000100:00100000:2.0:1783562362.231668:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611136 00000100:00100000:2.0:1783562362.231708:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783562362.231717:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563611136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562362.231854:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562362.231893:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611392 00000100:00100000:1.0:1783562362.231897:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611392 00000100:00100000:1.0:1783562362.231936:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611648 00000100:00100000:1.0:1783562362.231940:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611648 00000100:00100000:2.0:1783562362.231958:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563611136:12345-0@lo:400:kworker.0 Request processed in 240us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562362.231961:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611264 00000100:00100000:1.0:1783562362.231965:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611264 00000100:00100000:2.0:1783562362.231971:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783562362.231986:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783562362.231995:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563611392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783562362.232009:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562362.232038:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563611136:0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.232073:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611520 00000100:00100000:2.0:1783562362.232077:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611520 00000100:00100000:1.0:1783562362.232093:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563611392:12345-0@lo:400:kworker.0 Request processed in 98us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562362.232101:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783562362.232107:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611776 00000100:00100000:2.0:1783562362.232112:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611776 00000100:00100000:1.0:1783562362.232120:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783562362.232130:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563611648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.232139:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783562362.232148:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563611520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562362.232168:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563611648:12345-0@lo:400:kworker.0 Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562362.232177:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783562362.232191:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563611520:12345-0@lo:400:kworker.0 Request processed in 43us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562362.232194:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783562362.232204:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562362.232208:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.232222:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783562362.232229:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563611776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.232255:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563611776:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562362.232260:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783562362.232279:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562362.232344:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563611776:0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.232354:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563611648:0@lo:400:kworker.0 00010000:00080000:0.0:1783562362.232656:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6717b80 x1870200563611520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562362.232669:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563611520:0@lo:400:kworker.0 00000100:00100000:1.0:1783562362.232723:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563611264:12345-0@lo:400:kworker.0 Request processed in 518us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562362.232741:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783562362.232928:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563611264:0@lo:400:kworker.0 00000100:00100000:3.0:1783562362.233097:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563611392:0@lo:400:kworker.0 00000100:00100000:2.0:1783562362.742728:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563611904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562362.742820:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562362.742942:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563611904 00000100:00100000:3.0:1783562362.742953:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563611904 00000100:00100000:3.0:1783562362.743008:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783562362.743023:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563611904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562362.743069:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562362.743127:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563611904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562362.743133:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783562362.743266:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563611904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562362.743633:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562362.743676:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562362.743786:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612032 00000100:00100000:2.0:1783562362.743792:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612032 00000100:00100000:2.0:1783562362.743829:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783562362.743837:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783562362.743862:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562362.743903:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562362.743909:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783562362.743944:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6542300 x1870200563612032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562362.743960:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783562362.807433:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783562363.803774:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00000020:00000080:3.0:1783562363.803791:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfcef3a8800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00000020:00000080:0.0:1783562363.803878:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef3a8800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 for lustre-OST0000 00000020:00000080:0.0:1783562363.803951:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef3a8000 for lustre-OST0000 00010000:00010000:0.0:1783562363.830861:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562364.348619:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562364.348678:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562364.348704:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562364.348749:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562364.348791:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099392 00000100:00100000:2.0:1783562364.348802:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099392 00000100:00100000:1.0:1783562364.348838:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099264 00000100:00100000:1.0:1783562364.348845:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099264 00000100:00100000:2.0:1783562364.348876:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099648 00000100:00100000:2.0:1783562364.348881:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099648 00000100:00100000:1.0:1783562364.348892:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 251 00000100:00100000:1.0:1783562364.348906:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553099264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562364.348912:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:2.0:1783562364.348922:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553099392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562364.349024:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099520 00000100:00100000:0.0:1783562364.349029:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099520 00000100:00100000:0.0:1783562364.349062:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:0.0:1783562364.349070:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553099520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562364.349134:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553099392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 212us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562364.349136:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553099264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 232us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562364.349150:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:1.0:1783562364.349152:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 251 00000100:00100000:2.0:1783562364.349174:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:2.0:1783562364.349183:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553099648:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562364.349225:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553099648:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00080000:1.0:1783562364.349228:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562364.349235:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00080000:1.0:1783562364.349236:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562364.352601:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553099520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3514us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562364.352633:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00010000:00010000:2.0:1783562364.854932:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562365.880399:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783562366.368835:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1783562366.904608:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562367.350765:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563612416:0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.350766:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563612288:0@lo:400:kworker.0 00000100:00100000:2.0:1783562367.350845:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563612160:0@lo:400:kworker.0 00000100:00100000:3.0:1783562367.350911:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562367.350922:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562367.350926:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612544:0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.350993:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562367.351006:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612416 00000100:00100000:0.0:1783562367.351020:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612416 00000100:00100000:2.0:1783562367.351060:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563612672:0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.351118:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612544 00000100:00100000:2.0:1783562367.351120:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562367.351124:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612160 00000100:00100000:1.0:1783562367.351128:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612544 00000100:00100000:3.0:1783562367.351132:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612160 00000100:00100000:0.0:1783562367.351142:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612672 00000100:00100000:0.0:1783562367.351151:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612672 00000100:00100000:3.0:1783562367.351225:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783562367.351252:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562367.351253:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783562367.351253:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783562367.351279:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563612416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.351279:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562367.351285:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783562367.351306:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563612672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562367.351442:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563612160:12345-0@lo:400:kworker.0 Request processed in 203us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562367.351457:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783562367.351462:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563612672:12345-0@lo:400:kworker.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562367.351473:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563612416:12345-0@lo:400:kworker.0 Request processed in 197us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562367.351473:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612544:12345-0@lo:400:kworker.0 Request processed in 199us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562367.351485:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783562367.351485:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1783562367.351530:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562367.351537:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562367.351566:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563612416:0@lo:400:kworker.0 00000100:00100000:0.0:1783562367.351590:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783562367.351616:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563612160:0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.351618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562367.351657:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563612672:0@lo:400:kworker.0 00000100:00100000:0.0:1783562367.351658:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612288 00000100:00100000:0.0:1783562367.351666:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612288 00000100:00100000:1.0:1783562367.351672:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563612800:0@lo:400:kworker.0 00010000:00080000:2.0:1783562367.351684:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6543480 x1870200563612544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562367.351697:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612544:0@lo:400:kworker.0 00000100:00100000:0.0:1783562367.351732:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783562367.351740:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562367.351754:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563612288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562367.351779:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612800 00000100:00100000:2.0:1783562367.351786:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612800 00000100:00100000:0.0:1783562367.351835:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563612288:12345-0@lo:400:kworker.0 Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562367.351841:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1783562367.351865:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562367.351879:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783562367.351896:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563612288:0@lo:400:kworker.0 00000100:00100000:2.0:1783562367.351898:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563612800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562367.351964:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563612800:12345-0@lo:400:kworker.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562367.351970:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783562367.352031:0:3275:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1783562367.352039:0:3275:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf6741f80, transno 4294967300 00000100:00100000:0.0:1783562367.352069:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563612800:0@lo:400:kworker.0 00000100:00100000:1.0:1783562367.862900:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562367.862934:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563613056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562367.863023:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562367.863106:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562367.863132:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562367.863669:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613056 00000100:00100000:3.0:1783562367.863681:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613056 00000100:00100000:0.0:1783562367.863706:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563612928 00000100:00100000:0.0:1783562367.863712:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563612928 00000100:00100000:3.0:1783562367.863753:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783562367.863762:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563613056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562367.863801:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562367.863871:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563613056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562367.863877:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783562367.863891:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783562367.863896:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562367.863913:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562367.863935:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563612928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (803us total) trans 0 rc 0/0 00010000:00080000:1.0:1783562367.863940:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6541180 x1870200563613056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562367.863942:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783562367.863969:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563613056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562367.863987:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563612928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783562367.928209:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562368.951307:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562369.469570:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562369.469676:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562369.469717:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562369.469816:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562369.469861:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099904 00000100:00100000:0.0:1783562369.469874:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099904 00000100:00100000:0.0:1783562369.469965:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100160 00000100:00100000:0.0:1783562369.469969:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100160 00000100:00100000:0.0:1783562369.470011:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:0.0:1783562369.470023:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553099904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562369.470113:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553099904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562369.470124:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:0.0:1783562369.470181:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562369.470198:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553100160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562369.470244:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553100160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 52us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562369.470250:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562369.470307:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100032 00000100:00100000:0.0:1783562369.470312:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100032 00000100:00100000:0.0:1783562369.470518:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:0.0:1783562369.470543:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553100032:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562369.470583:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553099776 00000100:00100000:1.0:1783562369.470590:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553099776 00000100:00100000:1.0:1783562369.470647:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 253 00000100:00100000:0.0:1783562369.470662:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553100032:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 128us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562369.470665:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553099776:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562369.470674:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00080000:0.0:1783562369.470709:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562369.470715:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553099776:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 55us (1153us total) trans 0 rc 0/0 00000100:00080000:0.0:1783562369.470716:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562369.470730:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 253 00010000:00010000:1.0:1783562369.976030:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562370.998622:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562371.895182:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783562372.022856:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562372.470610:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783562372.470742:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563613312:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.470816:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562372.471096:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563613184:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471139:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562372.471152:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613312 00000100:00100000:2.0:1783562372.471162:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613312 00000100:00100000:2.0:1783562372.471216:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783562372.471228:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563613312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562372.471277:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613184 00000100:00100000:3.0:1783562372.471283:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613184 00000100:00100000:2.0:1783562372.471306:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563613312:12345-0@lo:400:kworker.0 Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562372.471318:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783562372.471319:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783562372.471329:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563613184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562372.471367:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563613184:12345-0@lo:400:kworker.0 Request processed in 40us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562372.471374:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783562372.471539:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563613312:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471551:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563613184:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471724:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563613568:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471755:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562372.471781:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562372.471787:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563613440:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471808:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562372.471829:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563613824:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471850:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562372.471865:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783562372.471870:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563613696:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.471893:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562372.471908:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613568 00000100:00100000:2.0:1783562372.471914:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613568 00000100:00080000:1.0:1783562372.471948:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562372.471954:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613824 00000100:00100000:2.0:1783562372.471957:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613824 00000100:00100000:2.0:1783562372.472004:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783562372.472022:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563613568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562372.472024:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783562372.472043:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563613824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562372.472070:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563613568:12345-0@lo:400:kworker.0 Request processed in 53us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562372.472078:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783562372.472092:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563613824:12345-0@lo:400:kworker.0 Request processed in 51us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562372.472110:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783562372.472130:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6540380 x1870200563613568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562372.472143:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563613568:0@lo:400:kworker.0 00000100:00100000:0.0:1783562372.472188:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613440 00000100:00100000:0.0:1783562372.472194:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613440 00000100:00100000:0.0:1783562372.472227:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613696 00000100:00100000:0.0:1783562372.472231:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613696 00000100:00100000:0.0:1783562372.472256:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783562372.472264:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563613440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562372.472277:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783562372.472286:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563613696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562372.472311:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563613440:12345-0@lo:400:kworker.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562372.472320:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563613696:12345-0@lo:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562372.472322:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783562372.472329:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783562372.472365:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563613440:0@lo:400:kworker.0 00000100:00080000:1.0:1783562372.472531:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783562372.472535:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562372.472556:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563613696:0@lo:400:kworker.0 00000100:00100000:1.0:1783562372.472566:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563613824:0@lo:400:kworker.0 00000100:00100000:2.0:1783562372.982728:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563613952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562372.982766:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563614080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562372.982807:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562372.982859:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562372.982980:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563613952 00000100:00100000:1.0:1783562372.982980:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614080 00000100:00100000:3.0:1783562372.982990:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563613952 00000100:00100000:1.0:1783562372.982990:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614080 00000100:00100000:1.0:1783562372.983050:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783562372.983056:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783562372.983060:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563614080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562372.983069:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563613952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783562372.983107:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1783562372.983151:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562372.983157:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563614080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562372.983163:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783562372.983243:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563614080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562372.983610:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563613952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 542us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562372.983618:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783562372.983725:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6543100 x1870200563613952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562372.983740:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563613952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783562373.046992:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562374.070777:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562374.591278:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562374.591328:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562374.591469:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562374.591517:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562374.591613:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100288 00000100:00100000:3.0:1783562374.591627:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100288 00000100:00100000:3.0:1783562374.591700:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 255 00000100:00100000:3.0:1783562374.591712:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553100288:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562374.591822:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553100288:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 110us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562374.591831:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 255 00000100:00100000:3.0:1783562374.591998:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100544 00000100:00100000:3.0:1783562374.592002:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100544 00000100:00100000:3.0:1783562374.592046:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:3.0:1783562374.592054:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553100544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562374.592102:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553100544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562374.592133:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00080000:3.0:1783562374.592151:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562374.593673:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100416 00000100:00100000:2.0:1783562374.593689:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100416 00000100:00100000:2.0:1783562374.593847:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100672 00000100:00100000:2.0:1783562374.593852:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100672 00000100:00080000:3.0:1783562374.593884:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562374.593902:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:3.0:1783562374.593911:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:2.0:1783562374.593914:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553100416:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562374.593920:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553100672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562374.594010:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553100672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 92us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562374.594019:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:2.0:1783562374.594738:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553100416:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 821us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562374.594748:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00010000:00010000:1.0:1783562375.094751:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562376.118737:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562377.143318:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562377.590973:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563614208:0@lo:400:kworker.0 00000100:00100000:0.0:1783562377.590973:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563614464:0@lo:400:kworker.0 00000100:00100000:1.0:1783562377.591094:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563614336:0@lo:400:kworker.0 00000100:00100000:0.0:1783562377.591110:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562377.591130:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562377.591206:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563614720:0@lo:400:kworker.0 00000100:00100000:1.0:1783562377.591214:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562377.591218:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614464 00000100:00100000:3.0:1783562377.591236:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614464 00000100:00100000:2.0:1783562377.591261:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614208 00000100:00100000:2.0:1783562377.591267:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614208 00000100:00100000:2.0:1783562377.591320:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783562377.591323:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614336 00000100:00100000:3.0:1783562377.591328:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614336 00000100:00100000:2.0:1783562377.591330:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563614208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562377.591350:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563614848:0@lo:400:kworker.0 00000100:00100000:3.0:1783562377.591369:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783562377.591384:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563614464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562377.591449:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563614208:12345-0@lo:400:kworker.0 Request processed in 120us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562377.591455:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783562377.591497:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562377.591514:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563614464:12345-0@lo:400:kworker.0 Request processed in 133us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562377.591530:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783562377.591537:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783562377.591545:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563614336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783562377.591575:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562377.591592:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563614336:12345-0@lo:400:kworker.0 Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562377.591600:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783562377.591619:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563614592:0@lo:400:kworker.0 00000100:00100000:3.0:1783562377.591641:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562377.591650:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614848 00000100:00100000:2.0:1783562377.591655:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614848 00000100:00100000:1.0:1783562377.591664:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562377.591708:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614592 00000100:00100000:2.0:1783562377.591711:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614592 00000100:00100000:2.0:1783562377.591729:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783562377.591735:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563614848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562377.591856:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563614464:0@lo:400:kworker.0 00000100:00100000:1.0:1783562377.591860:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563614336:0@lo:400:kworker.0 00000100:00100000:2.0:1783562377.591909:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563614848:12345-0@lo:400:kworker.0 Request processed in 171us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562377.591921:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783562377.591922:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563614848:0@lo:400:kworker.0 00000100:00100000:2.0:1783562377.591950:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783562377.591961:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563614592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783562377.591981:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562377.591990:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562377.592021:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563614592:12345-0@lo:400:kworker.0 Request processed in 62us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562377.592030:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783562377.592063:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614720 00000100:00100000:2.0:1783562377.592067:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614720 00010000:00080000:0.0:1783562377.592108:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6717480 x1870200563614592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562377.592109:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783562377.592120:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563614720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562377.592128:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563614592:0@lo:400:kworker.0 00000100:00100000:2.0:1783562377.592157:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563614720:12345-0@lo:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562377.592166:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783562377.592175:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562377.592344:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563614208:0@lo:400:kworker.0 00000100:00100000:3.0:1783562377.592360:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563614720:0@lo:400:kworker.0 00000100:00100000:0.0:1783562378.102760:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563614976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562378.102846:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562378.102863:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563615104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562378.102900:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562378.102929:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563614976 00000100:00100000:0.0:1783562378.102936:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563614976 00000100:00100000:0.0:1783562378.102975:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615104 00000100:00100000:0.0:1783562378.102978:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615104 00000100:00100000:0.0:1783562378.103270:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783562378.103278:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563614976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783562378.103313:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562378.103358:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563614976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562378.103365:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783562378.103380:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783562378.103387:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563615104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562378.103437:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562378.103468:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563615104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562378.103474:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783562378.103528:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563614976:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783562378.104938:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf663b800 x1870200563615104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562378.104958:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563615104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783562378.167052:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562379.191762:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562379.709639:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562379.709688:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100800 00000100:00100000:1.0:1783562379.709698:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100800 00000100:00100000:1.0:1783562379.709755:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 257 00000100:00100000:1.0:1783562379.709766:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553100800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562379.709897:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2364:x1870200553100800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 132us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562379.709906:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 257 00000100:00100000:3.0:1783562379.717201:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562379.717299:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553100928 00000100:00100000:1.0:1783562379.717308:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553100928 00000100:00100000:1.0:1783562379.717393:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:1.0:1783562379.717426:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553100928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562379.717503:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2364:x1870200553100928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 102us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562379.717512:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00080000:3.0:1783562379.717580:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562379.725326:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562379.725366:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101056 00000100:00100000:0.0:1783562379.725376:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101056 00000100:00100000:1.0:1783562379.725431:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562379.725461:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101184 00000100:00100000:1.0:1783562379.725465:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101184 00000100:00100000:0.0:1783562379.725504:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:1.0:1783562379.725515:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:0.0:1783562379.725516:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2360:x1870200553101056:12345-192.168.204.4@tcp:9:kworker.0 00000100:00100000:1.0:1783562379.725529:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553101184:12345-192.168.204.4@tcp:400:kworker.0 00000020:00000080:0.0:1783562379.725542:0:6549:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87fa5 00000100:00080000:0.0:1783562379.725550:0:6549:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e25800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783562379.725579:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1783562379.725599:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553101184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562379.725609:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00010000:00010000:1.0:1783562379.725656:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562379.725940:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+2:2360:x1870200553101056:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 428us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562379.725947:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00080000:3.0:1783562379.726020:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783562379.726034:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783562380.218299:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562381.111205:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783562381.240138:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562381.381460:0:11655:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:59:39 (1783562379) 00000001:00100000:0.0:1783562381.728387:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:0.0:1783562381.728560:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfcc7e26000/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:1.0:1783562381.728642:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc7e26000/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-OST0001 00000020:00000080:1.0:1783562381.728713:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc7e25800 for lustre-OST0001 00010000:00010000:1.0:1783562382.262864:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562382.420110:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562382.420320:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101312 00000100:00100000:2.0:1783562382.420354:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101312 00000100:00080000:3.0:1783562382.420526:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562382.420581:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:2.0:1783562382.420596:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:10204:x1870200553101312:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562382.420633:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562382.420677:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.420811:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.420836:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.420871:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562382.421246:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562382.421252:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562382.421384:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.421452:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c1 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.421479:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c1 expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562382.421492:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562382.421495:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562382.421501:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1dc00, rc 0) 00000100:00100000:2.0:1783562382.421631:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:10204:x1870200553101312:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1038us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562382.421642:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:3.0:1783562382.428621:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562382.428734:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101440 00000100:00100000:1.0:1783562382.428752:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101440 00000100:00100000:1.0:1783562382.428885:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:1.0:1783562382.428931:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:10205:x1870200553101440:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562382.428980:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562382.429027:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b8807e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211c8 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429162:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429189:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429207:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429227:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429235:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429242:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429927:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429956:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.429964:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562382.430066:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783562382.430071:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562382.430161:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430178:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430186:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430194:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430201:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562382.430208:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430218:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430236:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562382.430239:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562382.430245:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430262:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430283:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430289:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430296:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430302:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562382.430305:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430311:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430319:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562382.430321:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562382.430324:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430330:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8808c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430388:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b8807e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c8 expref: 8 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430451:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c8 expref: 7 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562382.430466:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc9774c00) 00010000:00010000:1.0:1783562382.430469:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562382.430472:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498000, rc 0) 00000100:00100000:1.0:1783562382.430579:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:10205:x1870200553101440:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1679us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562382.430590:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:1.0:1783562382.437250:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562382.437438:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101696 00000100:00100000:0.0:1783562382.437479:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101696 00000100:00100000:0.0:1783562382.437579:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562382.437592:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:10205:x1870200553101696:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562382.437626:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562382.437663:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b8809a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211cf expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.437786:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.437805:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.437824:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438041:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438088:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438100:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438814:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b880af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438826:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b880af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.438835:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b880af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562382.438861:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783562382.439136:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439144:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439151:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439158:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562382.439162:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439170:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439187:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc9774c00) 00010000:00010000:0.0:1783562382.439190:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562382.439195:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439201:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b880a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439220:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439227:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439247:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439254:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562382.439257:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439263:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439272:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bfce234e000) 00010000:00010000:0.0:1783562382.439275:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562382.439278:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439284:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b880a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439788:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b8809a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211cf expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439805:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b880af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211cf expref: 9 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562382.439814:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:0.0:1783562382.439816:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562382.439819:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9a00, rc 0) 00000100:00100000:0.0:1783562382.440595:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10205:x1870200553101696:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3361us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783562382.440617:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562382.447289:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562382.447739:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101824 00000100:00100000:2.0:1783562382.447756:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101824 00000100:00100000:2.0:1783562382.447891:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:2.0:1783562382.447904:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10205:x1870200553101824:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783562382.448212:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10205:x1870200553101824:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 Request processed in 311us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562382.448222:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:3.0:1783562382.710743:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563615232:0@lo:400:kworker.0 00000100:00100000:3.0:1783562382.710837:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562382.710902:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615232 00000100:00100000:2.0:1783562382.710922:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615232 00000100:00100000:2.0:1783562382.710995:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783562382.711009:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563615232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562382.711036:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563615488:0@lo:400:kworker.0 00000100:00100000:2.0:1783562382.711118:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563615232:12345-0@lo:400:kworker.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562382.711127:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783562382.711135:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563615360:0@lo:400:kworker.0 00000100:00100000:3.0:1783562382.711158:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563615232:0@lo:400:kworker.0 00000100:00100000:1.0:1783562382.711187:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562382.711197:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563615744:0@lo:400:kworker.0 00000100:00100000:2.0:1783562382.711267:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563615616:0@lo:400:kworker.0 00000100:00100000:2.0:1783562382.711310:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562382.711373:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615360 00000100:00100000:3.0:1783562382.711378:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615360 00000100:00100000:1.0:1783562382.711444:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563615872:0@lo:400:kworker.0 00000100:00100000:3.0:1783562382.711452:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783562382.711462:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563615360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562382.711552:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562382.711597:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615488 00000100:00100000:0.0:1783562382.711601:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615488 00000100:00100000:2.0:1783562382.711643:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615616 00000100:00100000:2.0:1783562382.711648:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615616 00000100:00100000:0.0:1783562382.711654:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783562382.711664:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563615488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562382.711692:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783562382.711703:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563615616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562382.711710:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563615488:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562382.711719:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783562382.711771:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563615616:12345-0@lo:400:kworker.0 Request processed in 70us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562382.711779:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783562382.711783:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563615488:0@lo:400:kworker.0 00000100:00080000:0.0:1783562382.711821:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783562382.711830:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783562382.711833:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf6523100 x1870200563615616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783562398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562382.711847:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562382.711852:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563615616:0@lo:400:kworker.0 00000100:00100000:0.0:1783562382.711896:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615744 00000100:00100000:0.0:1783562382.711900:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615744 00000100:00100000:1.0:1783562382.711923:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562382.711955:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783562382.711963:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562382.711970:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563615872 00000100:00080000:2.0:1783562382.711971:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562382.711977:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563615872 00000100:00100000:0.0:1783562382.712006:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563615744:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562382.712014:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1783562382.712036:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562382.712037:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783562382.712051:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563615872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562382.712053:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563615744:0@lo:400:kworker.0 00000100:00100000:1.0:1783562382.712114:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563615872:12345-0@lo:400:kworker.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562382.712120:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783562382.712200:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563615360:12345-0@lo:400:kworker.0 Request processed in 740us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562382.712207:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783562382.712231:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563615360:0@lo:400:kworker.0 00000100:00100000:2.0:1783562382.712244:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563615872:0@lo:400:kworker.0 00000040:00080000:3.0:1783562383.159936:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783562383.222688:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563616000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562383.222780:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562383.222950:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563616128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562383.222996:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562383.223100:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563616000 00000100:00100000:2.0:1783562383.223114:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563616000 00000100:00100000:2.0:1783562383.223229:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563616128 00000100:00100000:2.0:1783562383.223233:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563616128 00000100:00100000:3.0:1783562383.223303:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783562383.223316:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563616000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562383.223382:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562383.223483:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563616000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562383.223491:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783562383.223517:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783562383.223531:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563616128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562383.223560:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562383.223599:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563616128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562383.223606:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783562383.223672:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563616128:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783562383.223728:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf663a300 x1870200563616000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562383.223742:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563616000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783562383.288554:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562383.726243:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.726418:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553101952 00000100:00100000:0.0:1783562383.726434:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553101952 00000100:00100000:0.0:1783562383.726540:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:0.0:1783562383.726554:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10247:x1870200553101952:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562383.726578:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.726604:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211d6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726693:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726712:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726727:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726755:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726764:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.726771:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727292:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727300:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727306:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727319:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562383.727323:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727330:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727345:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562383.727347:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.727351:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727356:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b880c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727368:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727371:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727375:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727378:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562383.727380:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727383:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727393:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bfce234e000) 00010000:00010000:0.0:1783562383.727395:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.727396:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727399:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b880cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727469:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211d6 expref: 10 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727478:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562383.727480:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.727482:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211d6 expref: 10 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.727490:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562383.727630:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10247:x1870200553101952:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1078us (1400us total) trans 0 rc 301/301 00000100:00100000:0.0:1783562383.727637:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:3.0:1783562383.734763:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.736251:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102208 00000100:00100000:0.0:1783562383.736269:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102208 00000100:00100000:0.0:1783562383.736349:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:0.0:1783562383.736365:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10247:x1870200553102208:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:0.0:1783562383.737882:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562383.737938:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88077 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c1 expref: 9 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.737978:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562383.737997:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562383.738356:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.738373:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.738384:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.738398:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.739523:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.739541:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562383.741277:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783562383.741302:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741313:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741322:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741329:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562383.741345:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741356:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741381:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234ec00) 00010000:00010000:0.0:1783562383.741385:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.741391:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.741398:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562383.741441:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8b74ec3 reply state 000000004fa6502e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562383.741453:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562383.741629:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:10247:x1870200553102208:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 5261us (6878us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783562383.741643:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00010000:00010000:0.0:1783562383.743840:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743856:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743864:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743871:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562383.743876:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743908:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743927:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bfce234e100) 00010000:00010000:0.0:1783562383.743930:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.743935:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.743941:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b880d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562383.796167:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.796657:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102336 00000100:00100000:0.0:1783562383.796674:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102336 00000100:00100000:0.0:1783562383.796752:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:0.0:1783562383.796763:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10255:x1870200553102336:12345-192.168.204.4@tcp:101:lctl.0 00010000:00010000:0.0:1783562383.796797:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.796819:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211dd expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.796902:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.796921:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.796936:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562383.797023:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783562383.797034:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562383.797084:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.797110:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b880e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211dd expref: 11 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.797126:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211dd expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.797134:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:0.0:1783562383.797138:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562383.797141:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562383.797229:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:10255:x1870200553102336:12345-192.168.204.4@tcp:101:lctl.0 Request processed in 466us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562383.797238:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:3.0:1783562383.835628:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562383.836327:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102464 00000100:00100000:2.0:1783562383.836342:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102464 00000100:00100000:2.0:1783562383.836459:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562383.836475:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:10261:x1870200553102464:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562383.836509:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562383.836540:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b880ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211e4 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836663:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836685:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836701:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836716:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836742:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836750:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836924:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836934:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.836941:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562383.836991:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783562383.836995:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562383.837057:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837074:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837081:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837088:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837094:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562383.837099:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837116:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837131:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:2.0:1783562383.837134:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562383.837139:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837145:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b880f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837160:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837167:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837173:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837178:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562383.837180:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837185:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837192:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bfcc4c37f00) 00010000:00010000:2.0:1783562383.837194:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562383.837197:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837212:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b880fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837247:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b880ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211e4 expref: 12 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837632:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211e4 expref: 11 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.837646:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562383.837649:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783562383.837653:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c400, rc 0) 00000100:00100000:2.0:1783562383.837787:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:10261:x1870200553102464:12345-192.168.204.4@tcp:101:bash.0 Request processed in 1315us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562383.837800:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562383.841135:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.841249:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102720 00000100:00100000:0.0:1783562383.841262:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102720 00000100:00100000:0.0:1783562383.841351:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:0.0:1783562383.841367:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:10261:x1870200553102720:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562383.841465:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.841496:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b8810a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211eb expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841709:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841724:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841755:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841827:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841835:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.841842:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562383.842623:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1783562383.842814:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842824:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842833:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842877:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842898:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842906:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842912:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562383.842925:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842934:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842949:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562383.842952:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562383.842958:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.842965:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88111 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562383.842990:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bde19229 reply state 000000005f12ed41 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562383.843002:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783562383.843044:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b8810a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 14 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.843058:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 13 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.843065:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e000) 00010000:00010000:0.0:1783562383.843067:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562383.843069:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:0.0:1783562383.843316:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10261:x1870200553102720:12345-192.168.204.4@tcp:101:bash.0 Request processed in 1952us (2189us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783562383.843325:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00010000:00010000:1.0:1783562383.845272:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845289:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845314:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845320:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562383.845327:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845337:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845357:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234ec00) 00010000:00010000:1.0:1783562383.845360:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562383.845366:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.845372:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562383.847710:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.848071:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102848 00000100:00100000:0.0:1783562383.848089:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102848 00000100:00100000:0.0:1783562383.848148:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:0.0:1783562383.848159:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870200553102848:12345-192.168.204.4@tcp:8:bash.0 00010000:00080000:0.0:1783562383.848203:0:6550:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1783562383.848257:0:6550:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b8812d 00002000:00100000:0.0:1783562383.848277:0:6550:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aeded353-5c04-404d-8ca0-d71cfbeced3d/ffff9bfcc364b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562383.848295:0:6550:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783562383.848727:0:6550:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783562383.848766:0:6550:0:(import.c:65:import_set_state_nolock()) ffff9bfcc364a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562383.849005:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553102848:12345-192.168.204.4@tcp:8:bash.0 Request processed in 846us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562383.849016:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:3.0:1783562383.851107:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.851221:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553102976 00000100:00100000:0.0:1783562383.851233:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553102976 00000100:00080000:2.0:1783562383.851350:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562383.851359:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:0.0:1783562383.851378:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:0:x1870200553102976:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562383.852046:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.852091:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211f2 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562383.852125:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562383.852147:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=193s v=(0 0) 00010000:00010000:0.0:1783562383.852152:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562383.852162:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.852217:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.852232:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562383.852312:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:0:x1870200553102976:12345-192.168.204.4@tcp:101:bash.0 Request processed in 937us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562383.852324:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:3.0:1783562383.856159:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562383.856242:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553103104 00000100:00100000:2.0:1783562383.856254:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553103104 00000100:00100000:2.0:1783562383.856336:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:2.0:1783562383.856350:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:10261:x1870200553103104:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562383.856381:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562383.856488:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c211f9 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.856531:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 8 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.856562:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562383.856567:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562383.856574:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.856620:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 8 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.856636:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 8 pid: 6549 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562383.856653:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563616256:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562383.856839:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562383.860538:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562383.860614:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553103232 00000100:00100000:1.0:1783562383.860632:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553103232 00000100:00100000:0.0:1783562383.860650:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563616256:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562383.860703:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 9 pid: 6549 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.860705:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 9 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.860751:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:1.0:1783562383.860777:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:1.0:1783562383.860790:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553103232:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562383.860823:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562383.860860:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 9 pid: 6549 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.860902:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 9 pid: 6549 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.860935:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c7e52d/0x4738ba0933b88134 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f2 expref: 9 pid: 6549 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562383.860940:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:10261:x1870200553103104:12345-192.168.204.4@tcp:101:bash.0 Request processed in 4591us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562383.860956:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00010000:00010000:1.0:1783562383.860963:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562383.860970:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562383.860982:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.860994:0:7447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562383.861039:0:7447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562383.861058:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7447:1870200563616384:192.168.204.4@tcp:105: 00000100:00100000:1.0:1783562383.861521:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562383.864773:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7447:1870200563616384:192.168.204.4@tcp:105: 00010000:00010000:1.0:1783562383.864801:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562383.864861:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553103232:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 4072us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562383.864876:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:1.0:1783562383.866492:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562383.866593:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553103488 00000100:00100000:2.0:1783562383.866604:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553103488 00000100:00100000:2.0:1783562383.866667:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562383.866677:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10261:x1870200553103488:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:2.0:1783562383.867106:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10261:x1870200553103488:12345-192.168.204.4@tcp:35:bash.0 Request processed in 430us (714us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783562383.867114:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:3.0:1783562383.907829:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.907917:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553103744 00000100:00100000:0.0:1783562383.907929:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553103744 00000100:00100000:0.0:1783562383.908020:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:0.0:1783562383.908033:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10271:x1870200553103744:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562383.908065:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.908086:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21200 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562383.908223:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783562383.908576:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88142 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21200 expref: 16 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.908657:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:0.0:1783562383.908661:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562383.908666:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21200 expref: 16 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.908681:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:0.0:1783562383.908745:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10271:x1870200553103744:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 715us (930us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1783562383.908753:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:3.0:1783562383.912538:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.912604:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104000 00000100:00100000:0.0:1783562383.912739:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104000 00000100:00100000:0.0:1783562383.912822:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562383.912835:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10271:x1870200553104000:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562383.913188:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:10271:x1870200553104000:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 351us (660us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783562383.913199:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562383.956543:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562383.956653:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104128 00000100:00100000:3.0:1783562383.956667:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104128 00000100:00100000:3.0:1783562383.956724:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:3.0:1783562383.956734:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:10277:x1870200553104128:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562383.956763:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562383.956788:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21207 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.956901:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.956941:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.956955:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562383.957035:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783562383.957040:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562383.957068:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.957102:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21207 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.957121:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21207 expref: 17 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.957130:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:3.0:1783562383.957132:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562383.957136:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336000, rc 0) 00000100:00100000:3.0:1783562383.957228:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:10277:x1870200553104128:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 495us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562383.957236:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:3.0:1783562383.963952:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562383.964221:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104384 00000100:00100000:2.0:1783562383.964242:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104384 00000100:00100000:2.0:1783562383.964335:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:2.0:1783562383.964365:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:10277:x1870200553104384:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562383.964397:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562383.964467:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b8815e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2120e expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.964601:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.964623:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 18 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.964637:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.964681:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 18 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.964698:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 18 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562383.964715:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563616512:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562383.964986:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562383.967979:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563616512:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562383.968036:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562383.968243:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562383.968463:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104512 00000100:00100000:3.0:1783562383.968475:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104512 00010000:00010000:3.0:1783562383.968531:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 19 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562383.968595:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:3.0:1783562383.968610:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:2364:x1870200553104512:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562383.968629:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562383.968638:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 19 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968652:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 19 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968680:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8811f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211eb expref: 19 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968699:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e000) 00010000:00010000:3.0:1783562383.968705:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968715:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968722:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.968760:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562383.968805:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.968828:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562383.968848:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:2364:x1870200553104512:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 241us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562383.968858:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000004:00200000:2.0:1783562383.968859:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783562383.969116:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b8815e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2120e expref: 19 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.969134:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2120e expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.969140:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e000) 00010000:00010000:2.0:1783562383.969143:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562383.969145:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d200, rc 0) 00000100:00100000:2.0:1783562383.969191:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10277:x1870200553104384:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 4830us (5260us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783562383.969199:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:0.0:1783562383.973073:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562383.973177:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104768 00000100:00100000:3.0:1783562383.973190:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104768 00000100:00100000:3.0:1783562383.973297:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:3.0:1783562383.973309:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10277:x1870200553104768:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562383.973346:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562383.973350:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783562383.973391:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2120e expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973468:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e000) 00010000:00010000:3.0:1783562383.973483:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562383.973503:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21215 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973631:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973647:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973659:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562383.973674:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783562383.973815:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21215 expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973851:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21215 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.973860:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc89ea100) 00010000:00010000:3.0:1783562383.973863:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783562383.973866:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:3.0:1783562383.973943:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10277:x1870200553104768:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 635us (886us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783562383.973951:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:3.0:1783562383.978778:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562383.978956:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553104896 00000100:00100000:0.0:1783562383.978973:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553104896 00000100:00100000:0.0:1783562383.979048:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:0.0:1783562383.979060:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10277:x1870200553104896:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562383.979090:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562383.979113:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2121c expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.979197:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 20 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.979216:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 20 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562383.979238:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc89ea100) 00010000:00010000:0.0:1783562383.979241:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562383.979246:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:0.0:1783562383.979324:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10277:x1870200553104896:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 265us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562383.979332:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:1.0:1783562383.983997:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562383.984129:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105024 00000100:00100000:2.0:1783562383.984145:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105024 00000100:00100000:2.0:1783562383.984277:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:2.0:1783562383.984290:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553105024:12345-192.168.204.4@tcp:1:lfs.0 00010000:00010000:2.0:1783562383.984354:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.984379:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.984388:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562383.984393:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562383.984399:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.984484:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562383.984516:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562383.984534:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563616640:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562383.984640:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562383.990917:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563616640:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562383.990960:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562383.991919:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562383.992146:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105152 00000100:00100000:3.0:1783562383.992159:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105152 00002000:00100000:3.0:1783562383.992238:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bfcc3eb8700 x1870200553105152/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:224/0 lens 504/0 e 0 to 0 dl 1783562394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783562383.992250:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcc3eb8700 with x1870200553105152 ext(0->12) 00010000:00010000:3.0:1783562383.992262:0:6553:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 8 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562383.992282:0:6553:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 8 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562383.992291:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcc3eb8700 00000100:00100000:3.0:1783562383.992332:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562383.992343:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553105152:12345-192.168.204.4@tcp:4:lfs.0 00000001:00100000:3.0:1783562384.025531:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000001:00080000:1.0:1783562384.068508:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1783562384.068742:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553105152:12345-192.168.204.4@tcp:4:lfs.0 Request processed in 76388us (76817us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783562384.068769:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00002000:00100000:2.0:1783562384.068792:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bfcc3eb8700 x1870200553105152/t4294967299(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:224/0 lens 504/448 e 0 to 0 dl 1783562394 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562384.068804:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcc3eb8700 with x1870200553105152 ext(0->12) 00010000:00010000:2.0:1783562384.068822:0:6553:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.068850:0:6553:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562384.068861:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcc3eb8700 00000100:00100000:3.0:1783562384.073017:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.073154:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105280 00000100:00100000:0.0:1783562384.073175:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105280 00010000:00010000:0.0:1783562384.073265:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.073469:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:0.0:1783562384.073485:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553105280:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562384.073517:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783562384.073559:0:11471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783562384.073563:0:11471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783562382 00002000:00010000:0.0:1783562384.073566:0:11471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783562382 00002000:00010000:0.0:1783562384.073568:0:11471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783562382 00002000:00010000:0.0:1783562384.073570:0:11471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1783562384.073601:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.073620:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.073667:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbb44438/0x4738ba0933b8813b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211f9 expref: 7 pid: 6608 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.073694:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562384.073700:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562384.073708:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.073723:0:11471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.073774:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562384.073829:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073844:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.073900:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553105280:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 417us (896us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562384.073901:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.073915:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00010000:00010000:1.0:1783562384.073918:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073930:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073939:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562384.073945:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073955:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073984:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.073998:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b8818f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.074069:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553105024:12345-192.168.204.4@tcp:1:lfs.0 Request processed in 89780us (90085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562384.074080:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:3.0:1783562384.078192:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.078350:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105536 00000100:00100000:2.0:1783562384.078394:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105536 00000100:00080000:3.0:1783562384.078567:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562384.078607:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:2.0:1783562384.078622:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10277:x1870200553105536:12345-192.168.204.4@tcp:35:lfs.0 00000004:00010000:2.0:1783562384.078739:0:5758:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21215 expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562384.079251:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1783562384.079326:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1783562384.080368:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1783562384.080538:0:5758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.080572:0:5758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 24 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.080583:0:5758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.080648:0:5758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 24 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.080669:0:5758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 24 pid: 5754 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562384.080697:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563616768:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562384.080864:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1783562384.083590:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.083718:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563616768:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562384.083775:0:5758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.083863:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105664 00000100:00100000:1.0:1783562384.083889:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105664 00010000:00010000:1.0:1783562384.083950:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 25 pid: 5754 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.083999:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:1.0:1783562384.084012:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:2364:x1870200553105664:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562384.084041:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562384.084052:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 25 pid: 5754 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084069:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 25 pid: 5754 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084106:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2121c expref: 25 pid: 5754 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084161:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc89ea100) 00010000:00010000:1.0:1783562384.084169:0:7447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084184:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084194:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.084230:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562384.084273:0:5758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.084284:0:5758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.084522:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2364:x1870200553105664:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 506us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562384.084532:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 00000001:00080000:2.0:1783562384.084584:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783562384.084922:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1783562384.085123:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563616896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783562384.085223:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562384.085279:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cde40 going to sleep for 11 seconds 00000100:00100000:1.0:1783562384.085975:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563616896 00000100:00100000:1.0:1783562384.085997:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563616896 00000100:00100000:1.0:1783562384.086093:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562384.086104:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563616896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783562384.086262:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563616896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562384.086276:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562384.086343:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563616896:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1783562384.086843:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1783562384.087441:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1783562384.087589:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563617024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783562384.087674:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562384.087713:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7999000 going to sleep for 11 seconds 00000100:00100000:2.0:1783562384.087742:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563617024 00000100:00100000:2.0:1783562384.087751:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563617024 00000100:00100000:2.0:1783562384.087817:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562384.087836:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563617024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783562384.088180:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5758:x1870200563617024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 348us (505us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783562384.088187:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562384.088458:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563617024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783562384.088562:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1783562384.088616:0:5758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088630:0:5758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088639:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088646:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.088652:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088662:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088688:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc89ea100) 00010000:00010000:0.0:1783562384.088692:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783562384.088699:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.088705:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88196 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562384.089036:0:5758:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783562384.089755:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783562384.089786:0:5758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193346381582ns, next at 194346375752ns, rc = 0 00000001:00080000:0.0:1783562384.089798:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1783562384.090016:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc89ea100) 00010000:00010000:0.0:1783562384.090021:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783562384.090045:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b8817a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21215 expref: 28 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.090946:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:10277:x1870200553105536:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 12315us (12770us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783562384.090965:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000020:00080000:0.0:1783562384.090975:0:5758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783562384.096626:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.096795:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553105792 00000100:00100000:0.0:1783562384.096808:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553105792 00000100:00100000:0.0:1783562384.096923:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:0.0:1783562384.096936:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:10277:x1870200553105792:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562384.096970:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.097002:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8819d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21223 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.097074:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8819d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21223 expref: 28 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.097091:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8819d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21223 expref: 28 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.097111:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.097114:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562384.097118:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562384.097206:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:10277:x1870200553105792:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 272us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.097215:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:3.0:1783562384.101569:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562384.101664:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553106048 00000100:00100000:1.0:1783562384.101675:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553106048 00000100:00100000:1.0:1783562384.101754:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562384.101765:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5078450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:10277:x1870200553106048:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562384.102084:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5078450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10277:x1870200553106048:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 320us (528us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1783562384.102112:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562384.162559:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.163859:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553106304 00000100:00100000:2.0:1783562384.163898:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553106304 00000100:00100000:2.0:1783562384.164034:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:2.0:1783562384.164049:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10287:x1870200553106304:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562384.164088:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562384.164130:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b881a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2122a expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562384.164362:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783562384.164578:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b881a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2122a expref: 31 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.164603:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:2.0:1783562384.164607:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562384.164614:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b881a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2122a expref: 31 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.164630:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c800, rc 0) 00000100:00100000:2.0:1783562384.164759:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10287:x1870200553106304:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 713us (2215us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1783562384.164769:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:3.0:1783562384.170076:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.170143:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553106432 00000100:00100000:0.0:1783562384.170170:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553106432 00000100:00100000:0.0:1783562384.170263:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:0.0:1783562384.170277:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10287:x1870200553106432:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:0.0:1783562384.170425:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170451:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170467:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170486:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170495:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170502:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170654:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170664:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170670:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562384.170739:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170766:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170774:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170782:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170790:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.170796:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170805:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170819:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562384.170823:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.170829:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170836:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b881b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170856:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170861:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170867:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170889:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.170892:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170898:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170906:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e400) 00010000:00010000:0.0:1783562384.170908:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.170910:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170916:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170931:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170937:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170942:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170947:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.170949:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170955:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170971:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.170973:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.170976:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.170981:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.171077:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10287:x1870200553106432:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 801us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.171086:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:1.0:1783562384.175066:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.175550:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553106688 00000100:00100000:0.0:1783562384.175569:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553106688 00000100:00100000:0.0:1783562384.175655:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1783562384.175667:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10287:x1870200553106688:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562384.176080:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:10287:x1870200553106688:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 414us (1052us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783562384.176089:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562384.214289:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.214662:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553106944 00000100:00100000:2.0:1783562384.214675:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553106944 00000100:00100000:2.0:1783562384.214824:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:2.0:1783562384.214836:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:10290:x1870200553106944:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562384.214871:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562384.215002:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b881c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21231 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.215096:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.215111:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.215135:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216204:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216225:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216237:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216442:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216453:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216460:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562384.216474:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783562384.216610:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216618:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216625:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216631:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562384.216648:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216657:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216673:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562384.216677:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562384.216683:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216691:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b881ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.216707:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.217365:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.217371:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.217377:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562384.217381:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.217388:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.217398:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc4c37f00) 00010000:00010000:2.0:1783562384.218015:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562384.218038:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.218047:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b881d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.218123:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b881c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 34 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.218137:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 33 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.218146:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:2.0:1783562384.218148:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562384.218150:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1dc00, rc 0) 00000100:00100000:2.0:1783562384.218347:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10290:x1870200553106944:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 3511us (4076us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1783562384.218356:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:3.0:1783562384.222899:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.223083:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553107072 00000100:00100000:0.0:1783562384.223097:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553107072 00000100:00100000:0.0:1783562384.223178:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:0.0:1783562384.223190:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10290:x1870200553107072:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:0.0:1783562384.223299:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223328:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223366:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223620:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223630:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223638:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223645:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.223650:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223659:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223675:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.223678:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562384.223684:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.223691:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.223957:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10290:x1870200553107072:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 767us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.223966:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:1.0:1783562384.227505:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.228156:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553107328 00000100:00100000:0.0:1783562384.228230:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553107328 00000100:00100000:0.0:1783562384.228391:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562384.228428:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10290:x1870200553107328:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562384.228836:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:10290:x1870200553107328:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 433us (1434us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783562384.228845:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00010000:00010000:3.0:1783562384.314843:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562384.409279:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.409448:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553107584 00000100:00100000:0.0:1783562384.409466:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553107584 00000100:00100000:0.0:1783562384.409628:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:0.0:1783562384.409642:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:10321:x1870200553107584:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562384.409698:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.409736:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21238 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.409920:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.409942:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.409960:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562384.409979:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783562384.410194:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b881f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21238 expref: 37 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.410219:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21238 expref: 36 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.410255:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.410259:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562384.410270:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562384.410375:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10321:x1870200553107584:12345-192.168.204.4@tcp:101:cat.0 Request processed in 735us (1116us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783562384.410384:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:3.0:1783562384.413034:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562384.413133:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.413393:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553107712 00000100:00100000:0.0:1783562384.413445:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553107712 00000100:00100000:0.0:1783562384.413553:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:0.0:1783562384.413568:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:2363:x1870200553107712:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562384.413594:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562384.413643:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b881f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21238 expref: 36 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.413673:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.413680:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562384.413864:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553107968 00000100:00100000:1.0:1783562384.413869:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553107968 00000100:00100000:1.0:1783562384.413926:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1783562384.413935:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10321:x1870200553107968:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:0.0:1783562384.414323:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:2363:x1870200553107712:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 753us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.414335:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:1.0:1783562384.414367:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10321:x1870200553107968:12345-192.168.204.4@tcp:35:cat.0 Request processed in 432us (1232us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1783562384.414377:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1783562384.447212:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.447378:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553108224 00000100:00100000:0.0:1783562384.447396:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553108224 00000100:00100000:0.0:1783562384.447521:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:0.0:1783562384.447533:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10327:x1870200553108224:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1783562384.447572:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.447577:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783562384.447718:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88157 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21207 expref: 36 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.447761:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562384.447777:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562384.447797:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88206 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2123f expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.448293:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.448315:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 36 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.448326:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.448397:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 36 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.448484:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 36 pid: 6572 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.448505:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563617152:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562384.448735:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1783562384.451124:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563617152:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562384.451167:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.451366:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.451438:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553108352 00000100:00100000:0.0:1783562384.451448:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553108352 00010000:00010000:0.0:1783562384.451497:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 37 pid: 6572 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.451545:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:0.0:1783562384.451557:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:2363:x1870200553108352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562384.451577:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562384.451585:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 37 pid: 6572 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451598:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 37 pid: 6572 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451626:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b881dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21231 expref: 37 pid: 6572 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451655:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.451660:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451673:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451682:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.451719:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562384.451806:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.451815:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.451816:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:2363:x1870200553108352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.451827:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000004:00200000:1.0:1783562384.451841:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783562384.452183:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88206 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 37 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.452204:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 36 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.452211:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:1.0:1783562384.452214:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562384.452224:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:1.0:1783562384.452291:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10327:x1870200553108224:12345-192.168.204.4@tcp:101:dd.0 Request processed in 4759us (5097us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783562384.452300:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:1.0:1783562384.455040:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.455974:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553108608 00000100:00100000:2.0:1783562384.455989:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553108608 00000100:00100000:0.0:1783562384.456208:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:0.0:1783562384.456227:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:10327:x1870200553108608:12345-192.168.204.4@tcp:36:dd.0 00010000:00010000:0.0:1783562384.456818:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.456846:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.456865:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562384.456964:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783562384.456996:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062f89a5c reply state 00000000dd0bd7b9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.457007:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562384.457192:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:10327:x1870200553108608:12345-192.168.204.4@tcp:36:dd.0 Request processed in 964us (2164us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783562384.457204:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000020:00080000:0.0:1783562384.457214:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783562384.459359:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459472:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459483:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459519:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.459526:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459537:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459566:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.459570:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.459578:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.459585:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8821b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.607500:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562384.607767:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553108736 00000100:00100000:3.0:1783562384.607790:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553108736 00000100:00100000:3.0:1783562384.607908:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:3.0:1783562384.607926:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:10341:x1870200553108736:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:3.0:1783562384.607967:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562384.608011:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21246 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608141:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608166:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608184:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608234:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608244:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608252:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608586:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608600:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 39 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608610:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608662:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 39 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.608680:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 39 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562384.608704:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6704e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563617280:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562384.608894:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3900 going to sleep for 11 seconds 00000100:00100000:3.0:1783562384.615249:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.615639:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6704e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563617280:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562384.615688:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.615979:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553108992 00000100:00100000:1.0:1783562384.615991:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553108992 00000100:00100000:1.0:1783562384.616093:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:1.0:1783562384.616105:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:5570:x1870200553108992:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783562384.616754:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:5570:x1870200553108992:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 645us (1516us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1783562384.616765:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:1.0:1783562384.618847:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562384.618981:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109120 00000100:00100000:3.0:1783562384.618998:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109120 00010000:00010000:3.0:1783562384.619084:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 41 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562384.619141:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:3.0:1783562384.619153:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:2364:x1870200553109120:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562384.619175:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562384.619184:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 41 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619199:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 41 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619229:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b8820d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2123f expref: 41 pid: 5756 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619254:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562384.619260:0:7447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619274:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619283:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619443:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619459:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.619471:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1783562384.619525:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783562384.619532:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1783562384.619562:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:2364:x1870200553109120:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 410us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562384.619572:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000004:00010000:0.0:1783562384.619592:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619612:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619633:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619641:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619648:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619654:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.619659:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619668:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619680:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562384.619683:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.619687:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619699:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619712:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619719:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619726:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619739:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.619742:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619749:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619760:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc89ea300) 00010000:00010000:0.0:1783562384.619763:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.619767:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619773:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619835:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21246 expref: 40 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619854:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21246 expref: 39 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.619863:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.619876:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562384.619880:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:0.0:1783562384.619917:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:10341:x1870200553108736:12345-192.168.204.4@tcp:101:stat.0 Request processed in 11997us (12446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.619935:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:3.0:1783562384.680770:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.680922:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109376 00000100:00100000:2.0:1783562384.680947:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109376 00000100:00100000:2.0:1783562384.681138:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:2.0:1783562384.681155:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:10347:x1870200553109376:12345-192.168.204.4@tcp:36:truncate.0 00010000:00010000:2.0:1783562384.681293:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562384.681344:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21246 expref: 39 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.681382:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:2.0:1783562384.681474:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562384.681932:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.681954:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.681969:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562384.682036:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1783562384.682059:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079c96c99 reply state 00000000ace7439e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562384.682069:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562384.682227:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:10347:x1870200553109376:12345-192.168.204.4@tcp:36:truncate.0 Request processed in 1075us (1490us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783562384.682234:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 54 00000020:00080000:2.0:1783562384.682242:0:6572:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562384.685079:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685105:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685116:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685122:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562384.685128:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685138:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685208:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:1.0:1783562384.685212:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562384.685221:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.685228:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b8823e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562384.777652:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562384.778052:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109504 00000100:00100000:1.0:1783562384.778072:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109504 00000100:00100000:1.0:1783562384.778231:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:1.0:1783562384.778247:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:10361:x1870200553109504:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:1.0:1783562384.778287:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562384.778322:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88245 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2124d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778465:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778488:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778508:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778529:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778537:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778570:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778735:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778744:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778752:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562384.778827:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783562384.778834:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562384.778878:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778895:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778907:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778916:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778924:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778931:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562384.778937:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778954:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778971:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562384.778975:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562384.778982:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.778989:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8824c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779026:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779034:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779040:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779047:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562384.779050:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779056:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779065:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562384.779067:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562384.779070:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779089:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779139:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 42 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779156:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 41 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.779171:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:1.0:1783562384.779174:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562384.779177:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499e00, rc 0) 00000100:00100000:1.0:1783562384.779288:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:10361:x1870200553109504:12345-192.168.204.4@tcp:101:stat.0 Request processed in 1044us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562384.779297:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:2.0:1783562384.829765:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.829881:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562384.829933:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.830154:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109888 00000100:00100000:0.0:1783562384.830201:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109888 00000100:00100000:0.0:1783562384.830308:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:0.0:1783562384.830321:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553109888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562384.830461:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2362:x1870200553109888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 142us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.830471:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00080000:2.0:1783562384.830715:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562384.830892:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109760 00000100:00100000:1.0:1783562384.830898:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109760 00000100:00100000:1.0:1783562384.830945:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:1.0:1783562384.830953:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553109760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562384.831161:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553109632 00000100:00100000:3.0:1783562384.831168:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553109632 00000100:00100000:3.0:1783562384.831206:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 259 00000100:00100000:3.0:1783562384.831213:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2362:x1870200553109632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562384.831767:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2362:x1870200553109632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 549us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562384.831767:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553109760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 809us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562384.831788:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 259 00000100:00100000:1.0:1783562384.831789:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:2.0:1783562384.847491:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.847670:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553110144 00000100:00100000:0.0:1783562384.847687:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553110144 00000100:00100000:0.0:1783562384.847769:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:0.0:1783562384.847779:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:10371:x1870200553110144:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562384.847805:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.847834:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21254 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562384.848033:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783562384.848468:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88261 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21254 expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.848491:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:0.0:1783562384.848494:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562384.848502:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21254 expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.848525:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:0.0:1783562384.848682:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:10371:x1870200553110144:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 904us (1208us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1783562384.848690:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:2.0:1783562384.853932:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562384.855681:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553110400 00000100:00100000:1.0:1783562384.855718:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553110400 00000100:00100000:1.0:1783562384.855957:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:1.0:1783562384.855977:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:10371:x1870200553110400:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562384.856565:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:10371:x1870200553110400:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 590us (2645us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783562384.856579:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:3.0:1783562384.895144:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.895304:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553110656 00000100:00100000:0.0:1783562384.895318:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553110656 00000100:00100000:0.0:1783562384.895528:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:0.0:1783562384.895542:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:10377:x1870200553110656:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562384.895576:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.895601:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8826f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2125b expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.895746:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.895763:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 44 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.895780:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.895822:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 44 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.895837:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 44 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.895855:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563617408:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562384.896018:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcca746180 going to sleep for 11 seconds 00000100:00100000:0.0:1783562384.899841:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563617408:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562384.899845:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1783562384.899887:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562384.900039:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553110784 00000100:00100000:3.0:1783562384.900057:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553110784 00010000:00010000:3.0:1783562384.900172:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 45 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562384.900347:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:3.0:1783562384.900362:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+45:2363:x1870200553110784:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562384.900384:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562384.900392:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 45 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900445:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 45 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900480:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8825a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2124d expref: 45 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900520:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562384.900525:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900539:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900550:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562384.900649:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562384.900760:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+44:2363:x1870200553110784:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 400us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562384.900768:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 40 00010000:00010000:0.0:1783562384.901104:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.901115:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562384.901142:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783562384.901570:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8826f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 45 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.901595:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 44 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.901603:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.901606:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562384.901609:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562384.901714:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+44:10377:x1870200553110656:12345-192.168.204.4@tcp:101:bash.0 Request processed in 6173us (6585us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1783562384.901723:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:2.0:1783562384.905218:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562384.905304:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111040 00000100:00100000:1.0:1783562384.905323:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111040 00000100:00100000:1.0:1783562384.905463:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:1.0:1783562384.905479:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+44:10377:x1870200553111040:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:1.0:1783562384.906001:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.906026:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562384.906040:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562384.906161:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1783562384.906191:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000104991bd reply state 000000006a30bf03 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562384.906203:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562384.906365:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10377:x1870200553111040:12345-192.168.204.4@tcp:36:bash.0 Request processed in 888us (1156us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783562384.906374:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000020:00080000:1.0:1783562384.906381:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783562384.910268:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910289:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910298:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910304:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.910326:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910460:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910484:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.910488:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.910493:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.910500:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88284 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562384.911123:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.911245:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111168 00000100:00100000:0.0:1783562384.911257:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111168 00000100:00100000:0.0:1783562384.911332:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:0.0:1783562384.911344:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+46:10377:x1870200553111168:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562384.911371:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.911389:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8828b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21262 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.911526:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.911539:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 47 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.911545:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.911596:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 47 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.911606:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 47 pid: 5754 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.911618:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563617536:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562384.911695:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5120d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562384.915445:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563617536:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562384.915488:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562384.916568:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.916902:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111296 00000100:00100000:0.0:1783562384.916914:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111296 00010000:00010000:0.0:1783562384.916963:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 48 pid: 5754 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.917007:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:0.0:1783562384.917017:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:2363:x1870200553111296:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562384.917031:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562384.917039:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 48 pid: 5754 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.917447:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 48 pid: 5754 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.917515:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88276 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2125b expref: 48 pid: 5754 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.917542:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.917549:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.917563:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.918335:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.918399:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562384.918550:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:2363:x1870200553111296:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1531us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.918562:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 41 00010000:00010000:2.0:1783562384.918853:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.918889:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562384.918976:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783562384.918982:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562384.919011:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.919063:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8828b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21262 expref: 48 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.919088:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21262 expref: 47 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562384.919096:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:2.0:1783562384.919099:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562384.919102:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:2.0:1783562384.919135:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10377:x1870200553111168:12345-192.168.204.4@tcp:101:bash.0 Request processed in 7792us (8016us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562384.919144:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:2.0:1783562384.923639:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.923771:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111552 00000100:00100000:0.0:1783562384.923797:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111552 00000100:00100000:0.0:1783562384.924157:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:0.0:1783562384.924175:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+46:10377:x1870200553111552:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:0.0:1783562384.924673:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10377:x1870200553111552:12345-192.168.204.4@tcp:35:bash.0 Request processed in 501us (1053us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783562384.924684:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562384.975610:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.977018:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111808 00000100:00100000:0.0:1783562384.977044:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111808 00000100:00100000:0.0:1783562384.977152:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:0.0:1783562384.977190:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10387:x1870200553111808:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562384.977229:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562384.977260:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21269 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562384.977474:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783562384.977619:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88299 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21269 expref: 49 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.977635:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:0.0:1783562384.977638:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562384.977642:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21269 expref: 49 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.977658:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562384.977751:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:10387:x1870200553111808:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 566us (2160us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1783562384.977764:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:2.0:1783562384.981826:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562384.981908:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553111936 00000100:00100000:0.0:1783562384.981929:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553111936 00000100:00100000:0.0:1783562384.982011:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:0.0:1783562384.982022:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:10387:x1870200553111936:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:0.0:1783562384.982151:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982176:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982215:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982233:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982239:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982243:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982455:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982464:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982473:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562384.982558:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982581:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982590:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982598:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982618:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.982626:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982637:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982662:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562384.982667:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.982676:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982684:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982707:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982714:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982722:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982728:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.982731:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982737:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982759:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e400) 00010000:00010000:0.0:1783562384.982762:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.982764:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982771:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982790:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982796:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982801:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982806:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562384.982809:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982814:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982821:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562384.982823:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562384.982826:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562384.982831:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562384.982963:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:10387:x1870200553111936:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 936us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562384.982974:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:2.0:1783562384.987018:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562384.988556:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553112192 00000100:00100000:1.0:1783562384.988575:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553112192 00000100:00100000:1.0:1783562384.988676:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562384.988711:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:10387:x1870200553112192:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562384.989204:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10387:x1870200553112192:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 494us (2203us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1783562384.989214:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562385.018273:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.018809:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553112448 00000100:00100000:0.0:1783562385.018831:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553112448 00000100:00100000:0.0:1783562385.018938:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:0.0:1783562385.018953:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10390:x1870200553112448:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562385.018998:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.019039:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21270 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019193:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019215:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019230:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019250:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019257:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.019264:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020128:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b882d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020141:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b882d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020151:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b882d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.020168:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783562385.020342:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020352:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020358:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020365:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.020372:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020382:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020441:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562385.020448:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.020455:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020481:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b882c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020512:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020519:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020526:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020532:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.020535:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020542:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020552:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e400) 00010000:00010000:0.0:1783562385.020555:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.020558:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020566:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b882ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020640:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b882bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21270 expref: 52 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020655:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b882d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21270 expref: 51 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.020667:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562385.020669:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562385.020672:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562385.020848:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:10390:x1870200553112448:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1899us (2603us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1783562385.020868:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:2.0:1783562385.026107:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.026172:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.026185:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553112576 00000100:00100000:0.0:1783562385.026202:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553112576 00000100:00100000:3.0:1783562385.026365:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553112704 00000100:00100000:3.0:1783562385.026371:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553112704 00000100:00100000:3.0:1783562385.026493:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:3.0:1783562385.026510:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:2364:x1870200553112704:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562385.026542:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562385.026584:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b882d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21270 expref: 52 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.026627:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562385.026636:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562385.026733:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:2364:x1870200553112704:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 227us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.026741:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:0.0:1783562385.026795:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:0.0:1783562385.026808:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10390:x1870200553112576:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:0.0:1783562385.026927:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.026950:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.026966:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027010:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027019:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027027:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027034:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.027052:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027064:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027075:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:0.0:1783562385.027080:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562385.027086:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.027093:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.027142:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10390:x1870200553112576:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 339us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.027151:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:2.0:1783562385.029665:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.029729:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553112960 00000100:00100000:0.0:1783562385.029743:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553112960 00000100:00100000:0.0:1783562385.029830:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:0.0:1783562385.029843:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10390:x1870200553112960:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562385.030250:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:10390:x1870200553112960:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 407us (602us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783562385.030270:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:1.0:1783562385.128452:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.128877:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553113216 00000100:00100000:3.0:1783562385.128893:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553113216 00000100:00100000:3.0:1783562385.129047:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:3.0:1783562385.129062:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:10408:x1870200553113216:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:3.0:1783562385.129107:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562385.129142:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b882e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21277 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.129331:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b882ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.129354:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b882ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.129375:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b882ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562385.129399:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783562385.129663:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b882e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21277 expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.129693:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b882ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21277 expref: 53 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.129705:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562385.129708:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783562385.129712:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:3.0:1783562385.129829:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10408:x1870200553113216:12345-192.168.204.4@tcp:101:cat.0 Request processed in 771us (1435us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1783562385.129876:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:2.0:1783562385.158530:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.158846:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553113344 00000100:00100000:0.0:1783562385.158871:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553113344 00000100:00100000:0.0:1783562385.159010:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:0.0:1783562385.159025:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10409:x1870200553113344:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562385.159074:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.159200:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2127e expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159501:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159522:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159539:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.159718:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783562385.159724:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562385.159762:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159808:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b882fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2127e expref: 55 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159836:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2127e expref: 54 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.159848:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562385.159851:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562385.159865:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:0.0:1783562385.159982:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10409:x1870200553113344:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 957us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.159991:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:2.0:1783562385.168901:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.169151:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553113728 00000100:00100000:1.0:1783562385.169173:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553113728 00000100:00100000:1.0:1783562385.169356:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562385.169380:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10409:x1870200553113728:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562385.170054:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10409:x1870200553113728:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 682us (1170us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1783562385.170066:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562385.174701:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.174816:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553113856 00000100:00100000:3.0:1783562385.174905:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553113856 00000100:00100000:3.0:1783562385.175002:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562385.175015:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10409:x1870200553113856:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:3.0:1783562385.175036:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783562385.175071:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21262 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.175101:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b882ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21277 expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.175115:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8819d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21223 expref: 53 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.175126:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562385.175141:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562385.175205:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10409:x1870200553113856:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 194us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.175211:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:2.0:1783562385.177603:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.177716:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553113984 00000100:00100000:0.0:1783562385.177889:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553113984 00000100:00100000:0.0:1783562385.177955:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:0.0:1783562385.177971:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10409:x1870200553113984:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:0.0:1783562385.178131:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.178147:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.178158:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562385.178986:0:5756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783562385.179230:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783562385.179562:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783562385.179972:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10409:x1870200553113984:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 2002us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.179986:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:2.0:1783562385.201653:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.202065:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114112 00000100:00100000:0.0:1783562385.202082:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114112 00000100:00100000:0.0:1783562385.202194:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:0.0:1783562385.202207:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10411:x1870200553114112:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562385.202228:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.202251:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21285 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202345:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202365:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202461:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202479:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202484:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202489:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202606:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202612:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202617:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.202658:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783562385.202663:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562385.202680:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202691:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202697:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202758:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202764:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202769:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.202772:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202778:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202790:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562385.202792:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.202796:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202800:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202813:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202825:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202830:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202833:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.202840:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202844:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.202849:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e300) 00010000:00010000:0.0:1783562385.202850:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.202852:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.203034:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8831e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.203076:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 54 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.203088:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 53 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.203094:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562385.203095:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562385.203097:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:0.0:1783562385.203177:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10411:x1870200553114112:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 972us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.203184:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00000040:00080000:3.0:1783562385.207049:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783562385.207063:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562385.207120:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783562385.207129:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562385.207335:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6705f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563617664:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562385.209522:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5ab3180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562385.215145:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6705f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563617664:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562385.215887:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.216014:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114240 00000100:00100000:1.0:1783562385.216025:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114240 00000100:00100000:1.0:1783562385.216095:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:1.0:1783562385.216107:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114240:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783562385.216214:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114240:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.216223:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562385.219134:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.219513:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114368 00000100:00100000:3.0:1783562385.219557:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114368 00000100:00100000:0.0:1783562385.219813:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562385.219831:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114368:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562385.219889:0:5756:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783562385.220083:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114368:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 257us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.220093:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:2.0:1783562385.224457:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.224535:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114496 00000100:00100000:0.0:1783562385.224549:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114496 00000100:00100000:0.0:1783562385.224617:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:0.0:1783562385.224628:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114496:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.224727:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224751:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224767:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224785:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224793:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224799:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224833:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224843:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224850:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.224933:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783562385.224937:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562385.224953:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224967:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224974:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224982:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.224989:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.224993:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225001:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225012:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:0.0:1783562385.225015:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.225019:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225025:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b8832c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225039:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225054:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225059:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225063:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.225066:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225070:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225077:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bfce234e300) 00010000:00010000:0.0:1783562385.225079:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.225081:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225086:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88333 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225100:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225106:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225111:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225115:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.225122:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225128:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225135:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562385.225136:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.225139:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.225145:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8833a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.225224:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114496:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 598us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.225232:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:2.0:1783562385.228466:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.230041:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114752 00000100:00100000:0.0:1783562385.230064:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114752 00000100:00100000:0.0:1783562385.230182:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:0.0:1783562385.230344:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10413:x1870200553114752:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.230376:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.230429:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88341 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2128c expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230579:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230596:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230633:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.230646:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783562385.230756:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230815:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230824:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230830:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.230835:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230847:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230872:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562385.230876:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562385.230882:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230889:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230945:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88341 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2128c expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230975:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:0.0:1783562385.230978:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562385.230983:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88341 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2128c expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.230994:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562385.231088:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553114752:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 748us (2721us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1783562385.231097:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:2.0:1783562385.236980:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.237106:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553114880 00000100:00100000:0.0:1783562385.237119:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553114880 00000100:00100000:0.0:1783562385.237204:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:0.0:1783562385.237218:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553114880:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562385.237262:0:6572:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783562385.237495:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553114880:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.237506:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:2.0:1783562385.240222:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.240314:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553115136 00000100:00100000:1.0:1783562385.240328:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553115136 00000100:00100000:1.0:1783562385.240475:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:1.0:1783562385.240503:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553115136:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562385.240531:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562385.240536:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783562385.240580:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2127e expref: 54 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.240601:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562385.240607:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562385.240631:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88356 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21293 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783562385.241233:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1783562385.241543:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8835d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.241560:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8835d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.241572:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8835d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.241639:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88356 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21293 expref: 56 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.241659:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8835d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21293 expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.241667:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562385.241670:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562385.241680:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499600, rc 0) 00000100:00100000:1.0:1783562385.241755:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10413:x1870200553115136:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1252us (1539us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1783562385.241763:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:3.0:1783562385.244643:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.244757:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553115392 00000100:00100000:0.0:1783562385.244773:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553115392 00000100:00100000:0.0:1783562385.244915:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:0.0:1783562385.244927:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10413:x1870200553115392:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.244990:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562385.245015:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8835d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21293 expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245056:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562385.245073:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562385.245105:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245121:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245131:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245148:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245155:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245161:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245238:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245246:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245252:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245258:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.245262:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245276:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245284:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562385.245287:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.245291:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245296:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b8836b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245307:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245312:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245318:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245322:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.245325:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245330:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245337:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8ce87d6f (ffff9bfce234e300) 00010000:00010000:0.0:1783562385.245340:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.245342:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.245357:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88372 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ce87d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.245491:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553115392:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 565us (858us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783562385.245498:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:2.0:1783562385.248630:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.248808:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553115520 00000100:00100000:0.0:1783562385.248822:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553115520 00000100:00100000:0.0:1783562385.248940:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:0.0:1783562385.248953:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10413:x1870200553115520:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.248980:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.249008:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b88379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2129a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249051:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249065:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249078:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249192:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b88379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249214:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.249234:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562385.249238:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783562385.249242:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c8800, rc 0) 00000100:00100000:0.0:1783562385.249313:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10413:x1870200553115520:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 363us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.249320:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:1.0:1783562385.252053:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.252152:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553115776 00000100:00100000:2.0:1783562385.252165:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553115776 00000100:00100000:2.0:1783562385.252238:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:2.0:1783562385.252252:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10413:x1870200553115776:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562385.252373:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.252395:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.252452:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562385.252884:0:5754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783562385.252897:0:5754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194509493306ns, next at 195509490135ns, rc = 0 00000004:00010000:2.0:1783562385.253001:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079ae6aac reply state 00000000740e5495 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.253011:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562385.253151:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10413:x1870200553115776:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 900us (1112us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1783562385.253168:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00010000:00010000:1.0:1783562385.255381:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255444:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255455:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255462:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.255468:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255478:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255510:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562385.255515:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562385.255521:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.255529:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88387 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.256799:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.256847:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553115904 00000100:00100000:0.0:1783562385.256869:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553115904 00000100:00100000:0.0:1783562385.256939:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:0.0:1783562385.256950:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10413:x1870200553115904:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.256980:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.257003:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212a1 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.257070:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 57 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.257086:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 57 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.257106:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562385.257109:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562385.257113:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c9e00, rc 0) 00000100:00100000:0.0:1783562385.257178:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10413:x1870200553115904:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 229us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.257207:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:2.0:1783562385.261488:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.261564:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116032 00000100:00100000:0.0:1783562385.261576:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116032 00000100:00100000:0.0:1783562385.261680:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:0.0:1783562385.261689:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870200553116032:12345-192.168.204.4@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783562385.261879:0:6549:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1783562385.261926:0:6549:0:(genops.c:1406:class_connect()) connect: client aeded353-5c04-404d-8ca0-d71cfbeced3d, cookie 0x4738ba0933b88395 00002000:00100000:0.0:1783562385.261945:0:6549:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aeded353-5c04-404d-8ca0-d71cfbeced3d/ffff9bfcc3839800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562385.261989:0:6549:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783562385.262609:0:6549:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783562385.262658:0:6549:0:(import.c:65:import_set_state_nolock()) ffff9bfcef6a1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562385.262764:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2360:x1870200553116032:12345-192.168.204.4@tcp:8:lhsmtool_posix.0 Request processed in 1074us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.262775:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:1.0:1783562385.265323:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.265471:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116160 00000100:00100000:0.0:1783562385.265486:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116160 00000100:00100000:0.0:1783562385.265582:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:0.0:1783562385.265590:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:0:x1870200553116160:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783562385.266601:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783562385.293952:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1783562385.293977:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000100:00100000:3.0:1783562385.294672:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:0:x1870200553116160:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 28523us (28800us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783562385.294689:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:2.0:1783562385.297704:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.297787:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116416 00000100:00100000:0.0:1783562385.297801:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116416 00000100:00100000:0.0:1783562385.297961:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:0.0:1783562385.297977:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10413:x1870200553116416:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562385.298627:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:10413:x1870200553116416:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 652us (929us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783562385.298636:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562385.303570:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.303673:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116672 00000100:00100000:3.0:1783562385.303688:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116672 00000100:00100000:3.0:1783562385.303769:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:3.0:1783562385.303781:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:10413:x1870200553116672:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783562385.304016:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:10413:x1870200553116672:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 236us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.304024:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:2.0:1783562385.307250:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.307314:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116800 00000100:00100000:1.0:1783562385.307339:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116800 00000100:00100000:2.0:1783562385.307519:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:2.0:1783562385.307535:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:10413:x1870200553116800:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562385.307568:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562385.307600:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8839c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212a8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307694:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307712:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307726:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562385.307777:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562385.307806:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307836:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8839c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a8 expref: 60 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307852:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a8 expref: 59 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.307881:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:2.0:1783562385.307885:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783562385.307890:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1cc00, rc 0) 00000100:00100000:2.0:1783562385.307972:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10413:x1870200553116800:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 442us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562385.307980:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:3.0:1783562385.312843:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.312933:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553116928 00000100:00100000:0.0:1783562385.312946:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553116928 00000100:00100000:0.0:1783562385.313011:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:0.0:1783562385.313025:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553116928:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562385.313046:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.313067:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212af expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562385.313097:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f0090, blocks: 0x1 00010000:00010000:0.0:1783562385.313115:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=194s v=(0 0) 00010000:00010000:0.0:1783562385.313120:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562385.313127:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 6 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.313153:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 6 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.313165:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c8600, rc 0) 00000100:00100000:0.0:1783562385.313241:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553116928:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 219us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.313249:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562385.317559:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.317845:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117184 00000100:00100000:3.0:1783562385.317869:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117184 00000100:00100000:3.0:1783562385.317936:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:3.0:1783562385.317947:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10413:x1870200553117184:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783562385.318148:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10413:x1870200553117184:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 202us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.318158:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:3.0:1783562385.325651:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.325761:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117312 00000100:00100000:1.0:1783562385.325773:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117312 00000100:00100000:1.0:1783562385.325839:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562385.325851:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:10413:x1870200553117312:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562385.325883:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562385.325912:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212b6 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.325952:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.325962:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562385.325967:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562385.325973:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.326006:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.326020:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.326036:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563617792:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562385.326130:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562385.329098:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.329111:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563617792:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562385.329163:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.329192:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499600, rc 0) 00000100:00100000:1.0:1783562385.329353:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:10413:x1870200553117312:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 3501us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.329369:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:0.0:1783562385.329463:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117440 00000100:00100000:0.0:1783562385.329477:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117440 00010000:00010000:0.0:1783562385.329509:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.329548:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:0.0:1783562385.329558:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553117440:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562385.329574:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562385.329599:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.329614:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.329641:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000852186f5/0x4738ba0933b883aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212af expref: 7 pid: 6547 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.329656:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562385.329661:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562385.329670:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.329682:0:11471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.329716:0:11471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.329745:0:11471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11471:1870200563617920:192.168.204.4@tcp:105: 00000100:00100000:0.0:1783562385.329820:0:11471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562385.331655:0:11471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11471:1870200563617920:192.168.204.4@tcp:105: 00010000:00010000:0.0:1783562385.331685:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562385.331744:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553117440:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 2186us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.331756:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:3.0:1783562385.333079:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.333468:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117568 00000100:00100000:2.0:1783562385.333483:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117568 00002000:00100000:2.0:1783562385.333550:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bfcf6706300 x1870200553117568/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:226/0 lens 504/0 e 0 to 0 dl 1783562396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562385.333562:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6706300 with x1870200553117568 ext(0->8) 00002000:00010000:2.0:1783562385.333569:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6706300 00000100:00100000:2.0:1783562385.333605:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:2.0:1783562385.333616:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553117568:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783562385.334425:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2361:x1870200553117568:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 783us (1327us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783562385.334436:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00002000:00100000:2.0:1783562385.334445:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bfcf6706300 x1870200553117568/t4294967302(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:226/0 lens 504/448 e 0 to 0 dl 1783562396 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562385.334454:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6706300 with x1870200553117568 ext(0->8) 00002000:00010000:2.0:1783562385.334458:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6706300 00010000:00010000:3.0:1783562385.337295:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562385.337849:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.337912:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117696 00000100:00100000:0.0:1783562385.337925:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117696 00000100:00100000:0.0:1783562385.337993:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:0.0:1783562385.338004:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10413:x1870200553117696:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783562385.371317:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1783562385.371371:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1783562385.371434:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc3e29d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783562385.371441:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6652600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc3e29e40 00000020:00080000:1.0:1783562385.371445:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6652400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef18a000 00000020:00080000:2.0:1783562385.371477:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:1.0:1783562385.371526:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783562385.371679:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783562385.371704:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563618176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783562385.371707:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10413:x1870200553117696:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 33700us (33860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.371718:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:0.0:1783562385.371757:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563618048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783562385.371763:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562385.371804:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562385.371880:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563618176 00000100:00100000:1.0:1783562385.371888:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563618176 00000100:00100000:1.0:1783562385.371962:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563618048 00000100:00100000:1.0:1783562385.371966:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563618048 00000100:00100000:1.0:1783562385.371992:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783562385.372004:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563618176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783562385.372132:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783562385.372145:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563618048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783562385.372167:0:6547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1783562385.372193:0:6549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783562385.372198:0:6549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783562384 00002000:00010000:1.0:1783562385.372200:0:6549:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783562385.372202:0:6549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783562384 -> 1783562384 00002000:00010000:1.0:1783562385.372205:0:6549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1783562385.372219:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a4f008e, atime: 0x6a4f008e, ctime: 0x6a4f008e, blocks: 0xb 00010000:00010000:0.0:1783562385.372231:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.372253:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563618176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (488us total) trans 4294967303 rc 0/0 00000100:00080000:2.0:1783562385.372254:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783562385.372276:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=194s v=(0 0) 00000100:00100000:1.0:1783562385.372282:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1783562385.372284:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562385.372294:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.372313:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.372326:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.372335:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.372357:0:6547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783562385.372905:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf6341f80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1783562385.372922:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563618176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783562385.373049:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3274:x1870200563618048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 907us (1243us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783562385.373057:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1783562385.373093:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf6706d80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1783562385.373099:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563618048:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783562385.373743:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562385.373755:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.373772:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562385.373778:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.373789:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.373821:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.373831:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b883b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.373867:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562385.373869:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562385.373871:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562385.379285:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.379348:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553117824 00000100:00100000:1.0:1783562385.379366:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553117824 00000100:00100000:1.0:1783562385.379478:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:1.0:1783562385.379493:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2361:x1870200553117824:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783562385.398018:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1783562385.398065:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1783562385.398243:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553117824:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 18745us (18970us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.398271:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562385.400368:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.403288:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118080 00000100:00100000:1.0:1783562385.403308:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118080 00000100:00100000:1.0:1783562385.403373:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:1.0:1783562385.403386:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10413:x1870200553118080:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562385.403489:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562385.403539:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b883a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a8 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.403562:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562385.403568:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562385.403612:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.403631:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.403643:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562385.404352:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000763907f5 reply state 000000007c03a871 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.404364:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562385.404515:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10413:x1870200553118080:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1130us (4160us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783562385.404525:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00010000:00010000:1.0:1783562385.409430:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409459:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409467:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409474:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.409479:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409493:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409511:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562385.409515:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.409521:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.409527:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b883bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.412097:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.412174:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118208 00000100:00100000:1.0:1783562385.412187:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118208 00000100:00100000:1.0:1783562385.412264:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:1.0:1783562385.412277:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553118208:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783562385.412903:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783562385.412908:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783562384 -> 1783562383 00002000:00010000:1.0:1783562385.412911:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783562382 00002000:00010000:1.0:1783562385.412914:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783562384 -> 1783562383 00002000:00010000:1.0:1783562385.412936:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783562385.413022:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2362:x1870200553118208:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 746us (939us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783562385.413031:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:0.0:1783562385.415592:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.415791:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118464 00000100:00100000:1.0:1783562385.415805:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118464 00000100:00100000:1.0:1783562385.415953:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:1.0:1783562385.415968:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10413:x1870200553118464:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783562385.416079:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.416100:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 13 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.416109:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.416146:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 13 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.416160:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 13 pid: 5755 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.416178:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563618304:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562385.416320:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562385.421457:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.421476:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563618304:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562385.421505:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.421522:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118592 00000100:00100000:3.0:1783562385.421539:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118592 00010000:00010000:3.0:1783562385.421584:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 14 pid: 5755 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.421633:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:3.0:1783562385.421646:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2364:x1870200553118592:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562385.421665:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562385.421676:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 14 pid: 5755 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421691:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 14 pid: 5755 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421715:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b88380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2129a expref: 14 pid: 5755 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421736:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:3.0:1783562385.421742:0:7447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421752:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421760:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.421798:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562385.421866:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:2364:x1870200553118592:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 224us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.421874:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00010000:00010000:0.0:1783562385.421881:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421896:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421941:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421955:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421963:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421970:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.421976:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421985:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.421997:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562385.422000:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783562385.422005:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.422012:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b883c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.422068:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:10413:x1870200553118464:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 6104us (6485us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783562385.422079:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:2.0:1783562385.424924:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.425020:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118720 00000100:00100000:3.0:1783562385.425036:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118720 00000100:00100000:3.0:1783562385.425108:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562385.425119:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553118720:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783562385.425183:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.425207:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.425218:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562385.425224:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783562385.425229:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.425284:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.425301:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.425320:0:6550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6550:1870200563618432:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562385.425484:0:6550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562385.430440:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.430493:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553118848 00000100:00100000:0.0:1783562385.430504:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553118848 00010000:00010000:0.0:1783562385.430549:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 8 pid: 6608 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.430623:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:0.0:1783562385.430643:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553118848:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562385.430656:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562385.430679:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 8 pid: 6608 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.430694:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 8 pid: 6608 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.430726:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562385.430731:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562385.430743:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.430758:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.430785:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562385.430846:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553118848:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 204us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562385.430866:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00010000:00010000:3.0:1783562385.434750:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b883b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212b6 expref: 7 pid: 6608 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.434778:0:6550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6550:1870200563618432:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562385.434819:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434834:0:6550:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434841:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434898:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434910:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434922:0:6550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434929:0:6550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562385.434936:0:6550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434961:0:6550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.434995:0:6550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.435007:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5aaa374/0x4738ba0933b883cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.435138:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553118720:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 10019us (10224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.435152:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:2.0:1783562385.437763:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.437876:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553119104 00000100:00100000:3.0:1783562385.437951:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553119104 00000100:00100000:3.0:1783562385.438074:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:3.0:1783562385.438088:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:10413:x1870200553119104:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783562385.438211:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438232:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438246:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438602:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438624:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438633:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438674:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.438693:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 13 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.438712:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563618560:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562385.438828:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562385.444606:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.444687:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553119232 00000100:00100000:1.0:1783562385.444703:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553119232 00000100:00100000:3.0:1783562385.444729:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563618560:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562385.444762:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 14 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.444772:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.444817:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:1.0:1783562385.444829:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2363:x1870200553119232:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562385.444860:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562385.444867:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 14 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.444883:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 14 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.444919:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8838e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212a1 expref: 14 pid: 5756 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.444946:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562385.444955:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.444968:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.444979:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.445018:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562385.445092:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.445101:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.445111:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:2363:x1870200553119232:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 283us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.445120:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000001:00080000:3.0:1783562385.445424:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1783562385.445789:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1783562385.445850:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1783562385.445963:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563618688:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783562385.446036:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562385.446075:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562385.446379:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563618688 00000100:00100000:1.0:1783562385.446386:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563618688 00000100:00100000:1.0:1783562385.446449:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562385.446459:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6572:x1870200563618688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783562385.446661:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6572:x1870200563618688:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562385.446663:0:6572:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783562385.446673:0:6572:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf6341f80, transno 4294967303 00000100:00100000:1.0:1783562385.446675:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562385.446695:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563618688:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1783562385.447335:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783562385.447610:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563618816:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783562385.447665:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562385.447706:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c81f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562385.447787:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563618816 00000100:00100000:1.0:1783562385.447794:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563618816 00000100:00100000:1.0:1783562385.447881:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562385.447891:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6572:x1870200563618816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783562385.448076:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6572:x1870200563618816:12345-0@lo:1000:mdt00_003.0 Request processed in 187us (412us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783562385.448083:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562385.448122:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563618816:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783562385.448171:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448182:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448190:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448198:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562385.448203:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448212:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448235:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:3.0:1783562385.448238:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562385.448243:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448247:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448286:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448293:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448306:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448311:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562385.448314:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448321:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448330:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:3.0:1783562385.448333:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562385.448336:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448341:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88309 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448393:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448571:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 16 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.448580:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.448745:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 16 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.448761:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 16 pid: 6572 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.448776:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563618944:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562385.448903:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6ec0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562385.451773:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563618944:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562385.451812:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.452592:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.452645:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553119360 00000100:00100000:1.0:1783562385.452655:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553119360 00010000:00010000:1.0:1783562385.452710:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 17 pid: 6572 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.452765:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:1.0:1783562385.452780:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:2363:x1870200553119360:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562385.452805:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562385.452814:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 17 pid: 6572 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452844:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 17 pid: 6572 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452892:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21285 expref: 17 pid: 6572 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452920:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562385.452925:0:7447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452938:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452947:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.452985:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562385.453074:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453088:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.453088:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:2363:x1870200553119360:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 308us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.453101:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00010000:00010000:3.0:1783562385.453120:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453129:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453137:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453143:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562385.453148:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453156:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453166:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:3.0:1783562385.453169:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562385.453173:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453179:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b883e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453202:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453209:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453214:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453219:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562385.453222:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453227:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453236:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:3.0:1783562385.453239:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783562385.453242:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.453248:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.454071:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10413:x1870200553119104:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 15971us (16309us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1783562385.454083:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00000020:00080000:3.0:1783562385.454088:0:6572:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783562385.454272:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783562385.454279:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562385.454321:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783562385.454330:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562385.455790:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.455950:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553119616 00000100:00100000:2.0:1783562385.455964:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553119616 00000100:00100000:2.0:1783562385.456136:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562385.456148:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10413:x1870200553119616:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783562385.457076:0:5757:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783562385.457204:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1783562385.457256:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457274:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457287:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457298:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457305:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457312:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.457346:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783562385.457508:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:10413:x1870200553119616:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1358us (1725us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783562385.457518:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000020:00080000:2.0:1783562385.457525:0:5757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783562385.457673:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562385.457682:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.457690:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562385.457694:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.457709:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.457725:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bfcc4c37f00) 00010000:00010000:0.0:1783562385.457729:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783562385.457733:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.457739:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b883e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.457756:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562385.457758:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562385.457760:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562385.703362:0:11807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562385.703388:0:11807:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562385.703476:0:11807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783562385.703483:0:11807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783562385.792416:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.793192:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553119872 00000100:00100000:3.0:1783562385.793225:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553119872 00000100:00100000:3.0:1783562385.793311:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:3.0:1783562385.793324:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:10432:x1870200553119872:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562385.793354:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562385.793384:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212bd expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.794363:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.794388:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.794432:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562385.794448:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783562385.794719:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b883f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212bd expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.794739:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212bd expref: 19 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.794749:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:3.0:1783562385.794752:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783562385.794757:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:3.0:1783562385.794860:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10432:x1870200553119872:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1538us (2473us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783562385.794869:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:3.0:1783562385.797662:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.797972:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553120000 00000100:00100000:1.0:1783562385.798001:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553120000 00000100:00100000:1.0:1783562385.798126:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:1.0:1783562385.798140:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10432:x1870200553120000:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:1.0:1783562385.798234:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798253:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798277:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798294:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798302:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798309:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798681:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798690:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798697:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562385.798744:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798758:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798774:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798781:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798787:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.798792:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798800:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798813:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562385.798816:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.798820:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798826:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798838:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798855:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798862:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798867:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.798874:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798881:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798888:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc9774100) 00010000:00010000:1.0:1783562385.798890:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.798893:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798899:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8840c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798916:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798921:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798927:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798931:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.798934:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798939:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798946:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc9774800) 00010000:00010000:1.0:1783562385.798948:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.798956:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.798962:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.799066:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10432:x1870200553120000:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 928us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.799075:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:2.0:1783562385.830213:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.830340:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553120256 00000100:00100000:0.0:1783562385.830352:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553120256 00000100:00100000:0.0:1783562385.830437:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:0.0:1783562385.830449:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:10435:x1870200553120256:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562385.830475:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.830500:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b8841a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212c4 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830587:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830622:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830636:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830655:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830662:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.830667:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831017:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831023:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831028:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562385.831035:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783562385.831116:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831121:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831126:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831134:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.831137:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831142:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831152:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562385.831154:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.831157:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831161:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b88421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831170:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831174:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831177:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831180:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562385.831182:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831185:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831197:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e000) 00010000:00010000:0.0:1783562385.831199:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562385.831202:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831205:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831239:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b8841a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831248:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.831252:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562385.831253:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562385.831255:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c8800, rc 0) 00000100:00100000:0.0:1783562385.831302:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10435:x1870200553120256:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 857us (1101us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783562385.831307:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:2.0:1783562385.834814:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.834959:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553120384 00000100:00100000:3.0:1783562385.834978:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553120384 00000100:00100000:3.0:1783562385.835085:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:3.0:1783562385.835101:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10435:x1870200553120384:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562385.835186:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835210:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835228:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835469:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835483:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835492:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835500:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562385.835506:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835515:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835548:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:3.0:1783562385.835553:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562385.835581:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.835591:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8843d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.835713:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10435:x1870200553120384:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 605us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.835725:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:0.0:1783562385.841790:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.842562:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553120640 00000100:00100000:2.0:1783562385.842580:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553120640 00000100:00100000:2.0:1783562385.842646:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1783562385.842657:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5196c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10435:x1870200553120640:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562385.842956:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5196c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:10435:x1870200553120640:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 301us (1181us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783562385.842964:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1783562385.868460:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562385.868583:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553120896 00000100:00100000:0.0:1783562385.868596:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553120896 00000100:00100000:0.0:1783562385.868701:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:0.0:1783562385.868716:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:9966:x1870200553120896:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562385.868759:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562385.868791:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88444 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212cb expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.868954:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.868973:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.868982:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.869021:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562385.869035:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 23 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.869050:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563619072:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562385.869186:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562385.872638:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.872921:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121024 00000100:00100000:3.0:1783562385.872933:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121024 00000100:00100000:2.0:1783562385.872951:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563619072:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562385.872993:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.872995:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 24 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.873051:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1783562385.873064:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2364:x1870200553121024:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562385.873085:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562385.873093:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 24 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873105:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 24 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873137:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b8842f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212c4 expref: 24 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873160:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:3.0:1783562385.873165:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873219:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873227:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.873264:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562385.873358:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:2364:x1870200553121024:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 287us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562385.873368:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00010000:00010000:2.0:1783562385.873561:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.873572:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562385.873597:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783562385.873789:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b88444 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 24 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.873806:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.873811:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:2.0:1783562385.873818:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562385.873821:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c9e00, rc 0) 00000100:00100000:2.0:1783562385.873868:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:9966:x1870200553120896:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5156us (5469us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783562385.873875:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:0.0:1783562385.875803:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.875929:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121280 00000100:00100000:1.0:1783562385.875944:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121280 00000100:00100000:1.0:1783562385.876012:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:1.0:1783562385.876026:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:9966:x1870200553121280:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:1.0:1783562385.876383:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.876473:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.876492:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562385.876552:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1783562385.876579:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef0373d5 reply state 00000000189b97ac transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.876589:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783562385.876638:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1783562385.876754:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:9966:x1870200553121280:12345-192.168.204.4@tcp:36:bash.0 Request processed in 730us (966us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783562385.876763:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 89 00000020:00080000:1.0:1783562385.876786:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783562385.878608:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.878791:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121408 00000100:00100000:2.0:1783562385.878804:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121408 00010000:00010000:1.0:1783562385.878877:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.878891:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 90 00010000:00010000:1.0:1783562385.878891:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.878903:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.878908:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:9966:x1870200553121408:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562385.878911:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.878920:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.878929:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.878941:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562385.878948:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562385.878952:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.878957:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.878961:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212d2 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.878964:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88459 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.879061:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d2 expref: 27 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.879078:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d2 expref: 27 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.879101:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:2.0:1783562385.879103:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562385.879106:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:2.0:1783562385.879178:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:9966:x1870200553121408:12345-192.168.204.4@tcp:101:bash.0 Request processed in 275us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562385.879187:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:0.0:1783562385.883136:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.883255:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121536 00000100:00100000:2.0:1783562385.883270:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121536 00000100:00100000:2.0:1783562385.883342:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:2.0:1783562385.883907:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:9966:x1870200553121536:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562385.883931:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562385.883961:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212d9 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562385.883995:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4f008f, atime: 0x6a4f008e, ctime: 0x6a4f008f, blocks: 0xb 00010000:00010000:2.0:1783562385.884023:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=195s v=(0 0) 00010000:00010000:2.0:1783562385.884028:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562385.884037:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.884060:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.884078:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ca00, rc 0) 00000100:00100000:2.0:1783562385.884156:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:9966:x1870200553121536:12345-192.168.204.4@tcp:101:bash.0 Request processed in 254us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562385.884165:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562385.887385:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.887558:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121664 00000100:00100000:2.0:1783562385.887574:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121664 00002000:00010000:2.0:1783562385.887636:0:6553:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1783562385.887642:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6f8fb80 with x1870200553121664 ext(0->18446744073709551615) 00002000:00010000:2.0:1783562385.887657:0:6553:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6f8fb80. 00000100:00100000:2.0:1783562385.887687:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562385.887696:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553121664:12345-192.168.204.4@tcp:10:bash.0 00002000:00010000:2.0:1783562385.888065:0:6553:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783562385.888093:0:6553:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783562383 -> 1783562384 00002000:00010000:2.0:1783562385.888096:0:6553:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783562382 -> 1783562382 00002000:00010000:2.0:1783562385.888099:0:6553:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783562383 -> 1783562384 00002000:00010000:2.0:1783562385.888101:0:6553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783562385.888172:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553121664:12345-192.168.204.4@tcp:10:bash.0 Request processed in 477us (804us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783562385.888179:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00002000:00010000:2.0:1783562385.888183:0:6553:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1783562385.888268:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6f8fb80 with x1870200553121664 ext(0->18446744073709551615) 00002000:00010000:2.0:1783562385.888275:0:6553:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6f8fb80. 00000100:00100000:0.0:1783562385.938129:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.939238:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553121792 00000100:00100000:3.0:1783562385.939258:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553121792 00000100:00100000:1.0:1783562385.939788:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:1.0:1783562385.939820:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:10449:x1870200553121792:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:1.0:1783562385.939953:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.939974:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940014:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940028:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940033:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940043:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940444:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940453:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940457:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562385.940502:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940513:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940517:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940522:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940545:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.940549:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940559:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940569:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562385.940572:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.940575:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940579:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8846e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940591:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940595:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940599:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940602:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.940603:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940606:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940617:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc9774800) 00010000:00010000:1.0:1783562385.940619:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.940620:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940623:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940635:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940638:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940642:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940645:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562385.940646:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940649:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940653:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562385.940654:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562385.940656:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.940659:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8847c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.940766:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:10449:x1870200553121792:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 965us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.940772:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:0.0:1783562385.970746:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.970915:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553122048 00000100:00100000:2.0:1783562385.970929:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553122048 00000100:00100000:2.0:1783562385.971020:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:2.0:1783562385.971034:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:10452:x1870200553122048:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562385.971061:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562385.971094:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212e0 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971187:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971209:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971223:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971238:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971263:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971270:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971711:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971722:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971730:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562385.971740:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783562385.971856:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971863:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971869:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971874:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562385.971877:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971884:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971904:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562385.971907:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562385.971912:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971918:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8848a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971929:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971935:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971940:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971945:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562385.971948:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971953:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971959:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562385.971961:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562385.971963:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.971969:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.972034:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e0 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.972048:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e0 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.972055:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:2.0:1783562385.972057:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783562385.972060:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ce00, rc 0) 00000100:00100000:2.0:1783562385.972158:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10452:x1870200553122048:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1127us (1420us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1783562385.972166:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:0.0:1783562385.980832:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562385.980989:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553122176 00000100:00100000:3.0:1783562385.981001:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553122176 00000100:00100000:3.0:1783562385.981128:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:3.0:1783562385.981140:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10452:x1870200553122176:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562385.981215:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.981239:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 29 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.981250:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.981296:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 29 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562385.981311:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 29 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562385.981349:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6704e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563619200:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562385.981633:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562385.984585:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6704e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563619200:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562385.984635:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562385.986052:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.986839:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553122432 00000100:00100000:1.0:1783562385.986860:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553122432 00000100:00100000:1.0:1783562385.986946:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1783562385.986959:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:5570:x1870200553122432:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783562385.987387:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:5570:x1870200553122432:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 429us (1340us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1783562385.987396:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:0.0:1783562385.992293:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562385.992465:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553122560 00000100:00100000:1.0:1783562385.992480:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553122560 00010000:00010000:1.0:1783562385.992619:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 31 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562385.992674:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:1.0:1783562385.992684:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2363:x1870200553122560:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562385.992701:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562385.992708:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 31 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992721:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 31 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992746:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b8844b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212cb expref: 31 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992780:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562385.992788:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992805:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992817:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562385.992922:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562385.992991:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:2363:x1870200553122560:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 307us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562385.992999:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00010000:00010000:2.0:1783562385.993804:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993819:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993874:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993882:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993888:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993894:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562385.993900:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993919:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993935:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:2.0:1783562385.993938:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562385.993943:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562385.993950:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562385.994121:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10452:x1870200553122176:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 12981us (13297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562385.994131:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:0.0:1783562385.995830:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562385.995944:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553122816 00000100:00100000:2.0:1783562385.995955:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553122816 00000100:00100000:2.0:1783562385.996043:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:2.0:1783562385.996055:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:10452:x1870200553122816:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562385.996296:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10452:x1870200553122816:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 243us (472us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783562385.996304:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:0.0:1783562386.047554:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.048276:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553123072 00000100:00100000:3.0:1783562386.048292:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553123072 00000100:00100000:3.0:1783562386.048443:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:3.0:1783562386.048462:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:10463:x1870200553123072:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:3.0:1783562386.048499:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1783562386.048585:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783562386.049546:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b884ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212e7 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049684:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049705:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049722:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049749:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049759:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.049788:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050280:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b884c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050291:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b884c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050298:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b884c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562386.050312:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1783562386.050491:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050501:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050508:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050517:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562386.050522:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050533:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050552:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:3.0:1783562386.050555:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562386.050568:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050576:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b884b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050594:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050601:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050607:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050612:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562386.050616:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050622:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050631:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc89eae00) 00010000:00010000:3.0:1783562386.050633:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562386.050637:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050643:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b884bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050701:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b884ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e7 expref: 33 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050733:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b884c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e7 expref: 32 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.050741:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:3.0:1783562386.050744:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562386.050747:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:3.0:1783562386.050874:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:10463:x1870200553123072:12345-192.168.204.4@tcp:101:cat.0 Request processed in 2418us (3334us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1783562386.050884:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:0.0:1783562386.056296:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.056933:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553123328 00000100:00100000:1.0:1783562386.056949:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553123328 00000100:00100000:1.0:1783562386.057035:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:1.0:1783562386.057046:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:10463:x1870200553123328:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:1.0:1783562386.057849:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10463:x1870200553123328:12345-192.168.204.4@tcp:35:cat.0 Request processed in 794us (1566us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1783562386.057859:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:0.0:1783562386.079188:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.079276:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553123584 00000100:00100000:1.0:1783562386.079298:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553123584 00000100:00100000:1.0:1783562386.079387:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:1.0:1783562386.079443:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10464:x1870200553123584:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1783562386.079545:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783562386.079595:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b884c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e7 expref: 33 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079624:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212e0 expref: 32 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079638:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d2 expref: 31 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079648:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562386.079660:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562386.079689:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079705:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079716:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079732:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079740:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.079746:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080143:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080163:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080170:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562386.080895:0:5754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:1.0:1783562386.080969:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080981:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080990:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.080998:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081004:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081007:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081037:0:5754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562386.081069:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081075:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081091:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081097:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.081102:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081110:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081122:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562386.081126:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783562386.081130:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081137:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b884de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081157:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081164:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081170:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081175:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.081178:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081195:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081204:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562386.081207:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562386.081210:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.081216:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b884d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562386.081227:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b1cbc9c reply state 00000000fa5d3e3c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.081238:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562386.081346:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:10464:x1870200553123584:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1945us (2176us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783562386.081358:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 95 00010000:00010000:3.0:1783562386.081509:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562386.081519:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.081526:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562386.081530:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.081537:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.081548:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bfcc9774100) 00010000:00010000:3.0:1783562386.081550:0:5742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783562386.081554:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.081562:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b884e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.081581:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562386.081592:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562386.081594:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562386.083380:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083516:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083526:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083532:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.083538:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083577:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083599:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc9774800) 00010000:00010000:1.0:1783562386.083602:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562386.083607:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.083614:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b884d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.112892:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.113040:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553123840 00000100:00100000:2.0:1783562386.113066:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553123840 00000100:00100000:2.0:1783562386.113192:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:2.0:1783562386.113298:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:10470:x1870200553123840:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562386.113335:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562386.113388:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b884ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212ee expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113704:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113723:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113736:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113749:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113756:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.113761:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562386.115047:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783562386.115334:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.115347:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.115357:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.115388:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116182:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116190:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116197:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562386.116202:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116211:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116227:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562386.116230:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562386.116236:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116242:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b884f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562386.116262:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048f88042 reply state 00000000fc57093b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.116274:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783562386.116333:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b884ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 34 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116348:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 33 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.116369:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562386.116371:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562386.116374:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c000, rc 0) 00000100:00100000:2.0:1783562386.116595:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:10470:x1870200553123840:12345-192.168.204.4@tcp:101:bash.0 Request processed in 3300us (3723us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783562386.116607:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00010000:00010000:1.0:1783562386.119085:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119113:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119121:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119128:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.119136:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119147:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119170:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc4c37500) 00010000:00010000:1.0:1783562386.119174:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562386.119179:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.119211:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b884fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.122827:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.122975:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553123968 00000100:00100000:1.0:1783562386.122993:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553123968 00000100:00100000:1.0:1783562386.123151:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:1.0:1783562386.123163:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2362:x1870200553123968:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562386.123183:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562386.123219:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212f5 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562386.123252:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562386.123277:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=195s v=(0 0) 00010000:00010000:1.0:1783562386.123282:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562386.123293:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 6 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.123321:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 6 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.123340:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499600, rc 0) 00000100:00100000:1.0:1783562386.123458:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553123968:12345-192.168.204.4@tcp:101:bash.0 Request processed in 298us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562386.123466:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00080000:2.0:1783562386.124270:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562386.128186:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.129232:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124096 00000100:00100000:1.0:1783562386.129250:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124096 00000100:00100000:1.0:1783562386.129354:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:1.0:1783562386.129367:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:10470:x1870200553124096:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562386.129390:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562386.129534:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c212fc expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.129588:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.129601:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562386.129607:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562386.129614:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.129674:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.129691:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 295 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.129785:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563619328:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562386.129970:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562386.134970:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563619328:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562386.135066:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.135139:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499a00, rc 0) 00000100:00100000:1.0:1783562386.135339:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:10470:x1870200553124096:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5972us (7167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562386.135354:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:0.0:1783562386.135752:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.136091:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124224 00000100:00100000:2.0:1783562386.136111:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124224 00010000:00010000:2.0:1783562386.136180:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 295 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.136226:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:2.0:1783562386.136240:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553124224:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562386.136261:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562386.136295:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 295 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.136313:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 295 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.136350:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b8850f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212f5 expref: 7 pid: 6549 timeout: 295 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.136373:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562386.136399:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562386.136476:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.136487:0:5740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.136539:0:5740:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.136556:0:5740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5740:1870200563619456:192.168.204.4@tcp:105: 00000100:00100000:2.0:1783562386.136682:0:5740:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5880840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562386.138643:0:5740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5740:1870200563619456:192.168.204.4@tcp:105: 00010000:00010000:2.0:1783562386.138677:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562386.138836:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553124224:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 2598us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.138857:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:0.0:1783562386.139608:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.139705:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124480 00000100:00100000:2.0:1783562386.139714:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124480 00000100:00100000:2.0:1783562386.139832:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:2.0:1783562386.139856:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:10470:x1870200553124480:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:1.0:1783562386.139861:0:5757:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1783562386.139885:0:5757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1783562386.140741:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:10470:x1870200553124480:12345-192.168.204.4@tcp:35:bash.0 Request processed in 880us (1129us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783562386.140751:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:0.0:1783562386.247802:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.247891:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124608 00000100:00100000:2.0:1783562386.247903:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124608 00000100:00100000:2.0:1783562386.248043:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:2.0:1783562386.248054:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:10486:x1870200553124608:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562386.248078:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562386.248099:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8851d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21303 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248188:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248202:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248214:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562386.248273:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1783562386.248277:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562386.248300:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248323:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8851d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21303 expref: 36 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248341:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21303 expref: 35 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.248350:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562386.248353:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562386.248357:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1dc00, rc 0) 00000100:00100000:2.0:1783562386.248468:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:10486:x1870200553124608:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 414us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.248481:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:0.0:1783562386.252929:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.253398:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124864 00000100:00100000:3.0:1783562386.253456:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124864 00000100:00100000:3.0:1783562386.253575:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:3.0:1783562386.253594:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:10486:x1870200553124864:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562386.253633:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562386.253666:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b8852b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2130a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.253854:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.253874:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.253900:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562386.253917:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783562386.254128:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b8852b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2130a expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.254157:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2130a expref: 37 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.254170:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:3.0:1783562386.254173:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562386.254178:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336800, rc 0) 00000100:00100000:3.0:1783562386.254300:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:10486:x1870200553124864:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 711us (1381us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1783562386.254330:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:0.0:1783562386.258812:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562386.258929:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.259042:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553124992 00000100:00100000:1.0:1783562386.259050:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553125248 00000100:00100000:3.0:1783562386.259063:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553124992 00000100:00100000:1.0:1783562386.259081:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553125248 00000100:00100000:3.0:1783562386.259188:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562386.259198:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:3.0:1783562386.259208:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:2362:x1870200553124992:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783562386.259222:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:10486:x1870200553125248:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562386.259244:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562386.259261:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562386.259298:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2130a expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.259301:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21311 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.259359:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:3.0:1783562386.259368:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562386.259546:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:2362:x1870200553124992:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 343us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562386.259558:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00010000:00010000:1.0:1783562386.259582:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.259604:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.259622:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562386.259641:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783562386.259867:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b88540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21311 expref: 39 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.259895:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21311 expref: 38 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.259923:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:1.0:1783562386.259925:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783562386.259929:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498800, rc 0) 00000100:00100000:1.0:1783562386.260027:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:10486:x1870200553125248:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 818us (1099us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1783562386.260034:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:0.0:1783562386.264212:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.264269:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553125376 00000100:00100000:3.0:1783562386.264286:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553125376 00000100:00100000:3.0:1783562386.264379:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:3.0:1783562386.264394:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553125376:12345-192.168.204.4@tcp:1:lfs.0 00010000:00010000:3.0:1783562386.264539:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.264568:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.264578:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562386.264583:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783562386.264606:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.264650:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.264663:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 6 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.264678:0:6550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6705180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6550:1870200563619584:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562386.264805:0:6550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562386.268973:0:6550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6705180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6550:1870200563619584:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562386.269032:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.269463:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.270960:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553125504 00000100:00100000:2.0:1783562386.270988:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553125504 00002000:00100000:2.0:1783562386.271993:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bfcef107100 x1870200553125504/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:227/0 lens 504/0 e 0 to 0 dl 1783562397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562386.272009:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef107100 with x1870200553125504 ext(0->8) 00010000:00010000:2.0:1783562386.272022:0:6555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 7 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.272045:0:6555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 7 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562386.272056:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcef107100 00000100:00100000:2.0:1783562386.272107:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562386.272124:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553125504:12345-192.168.204.4@tcp:4:lfs.0 00000100:00100000:2.0:1783562386.273649:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553125504:12345-192.168.204.4@tcp:4:lfs.0 Request processed in 1513us (4169us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783562386.273667:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00002000:00100000:2.0:1783562386.273680:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bfcef107100 x1870200553125504/t4294967302(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:227/0 lens 504/448 e 0 to 0 dl 1783562397 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562386.273692:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef107100 with x1870200553125504 ext(0->8) 00010000:00010000:2.0:1783562386.273704:0:6555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.273740:0:6555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562386.273749:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcef107100 00000100:00100000:0.0:1783562386.277091:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.277208:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553125632 00000100:00100000:1.0:1783562386.277232:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553125632 00010000:00010000:1.0:1783562386.277315:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.277386:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:1.0:1783562386.277400:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553125632:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562386.277474:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783562386.277511:0:11471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783562386.277515:0:11471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783562384 00002000:00010000:1.0:1783562386.277518:0:11471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783562385 00002000:00010000:1.0:1783562386.277521:0:11471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783562384 00010000:00010000:1.0:1783562386.277530:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.277552:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.277611:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b88516 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212fc expref: 9 pid: 6608 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.277665:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562386.277671:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562386.277678:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.277691:0:11471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.277791:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562386.277850:0:6550:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277867:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277906:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277918:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277941:0:6550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.277947:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553125632:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 546us (869us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562386.277955:0:6550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562386.277961:0:6550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.277964:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00010000:00010000:3.0:1783562386.277974:0:6550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277989:0:6550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.277996:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88555 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.278060:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553125376:12345-192.168.204.4@tcp:1:lfs.0 Request processed in 13671us (13869us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562386.278066:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:0.0:1783562386.280259:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.280398:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553125888 00000100:00100000:2.0:1783562386.280522:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553125888 00000100:00100000:2.0:1783562386.280632:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562386.280646:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5197c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:10486:x1870200553125888:12345-192.168.204.4@tcp:35:lfs.0 00000004:00010000:2.0:1783562386.280753:0:5758:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21311 expref: 38 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562386.281228:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1783562386.281261:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1783562386.281808:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1783562386.281910:0:5758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.281943:0:5758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 42 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.281957:0:5758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.282019:0:5758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 42 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.282042:0:5758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 42 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.282098:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563619712:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562386.282298:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562386.285360:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563619712:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562386.285453:0:5758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.285599:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.285725:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126016 00000100:00100000:2.0:1783562386.285736:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126016 00010000:00010000:2.0:1783562386.285794:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 43 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.285903:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:2.0:1783562386.285917:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:2364:x1870200553126016:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562386.285953:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562386.285964:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 43 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.285981:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 43 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.286013:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212ee expref: 43 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.286032:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562386.286038:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.286074:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.286083:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.286132:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562386.286220:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:2364:x1870200553126016:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 304us (621us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562386.286226:0:5758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.286233:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00010000:00010000:3.0:1783562386.286243:0:5758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783562386.286997:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783562386.287349:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783562386.287589:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6705180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563619840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783562386.287686:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562386.287741:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562386.287757:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563619840 00000100:00100000:2.0:1783562386.287769:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563619840 00000100:00100000:2.0:1783562386.287877:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562386.287889:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5758:x1870200563619840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1783562386.288016:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562386.288041:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5758:x1870200563619840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.288051:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562386.288111:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6705180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563619840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783562386.289453:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1783562386.289972:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef104380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563619968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783562386.290064:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562386.290100:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562386.290117:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563619968 00000100:00100000:2.0:1783562386.290128:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563619968 00000100:00100000:2.0:1783562386.290189:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562386.290197:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5758:x1870200563619968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783562386.290442:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5758:x1870200563619968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 245us (378us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783562386.290450:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562386.290501:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef104380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563619968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783562386.290593:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1783562386.290655:0:5758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290692:0:5758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290703:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290711:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562386.290720:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290731:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290764:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:0.0:1783562386.290768:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783562386.290777:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.290785:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8855c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562386.291138:0:5758:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783562386.291377:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1783562386.291397:0:5758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 195547993375ns, next at 196547988700ns, rc = 0 00000001:00080000:0.0:1783562386.291446:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1783562386.291499:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:0.0:1783562386.291503:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783562386.291515:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88547 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21311 expref: 46 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.291752:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5197c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+45:10486:x1870200553125888:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 11107us (11505us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1783562386.291765:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000020:00080000:0.0:1783562386.291771:0:5758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783562386.296035:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.296196:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126144 00000100:00100000:2.0:1783562386.296212:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126144 00000100:00100000:2.0:1783562386.296304:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1783562386.296347:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+45:10486:x1870200553126144:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562386.296552:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562386.296600:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21318 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.296702:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21318 expref: 46 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.296723:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21318 expref: 46 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.296772:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562386.296775:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562386.296783:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c000, rc 0) 00000100:00100000:2.0:1783562386.296908:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+46:10486:x1870200553126144:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 566us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.296918:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1783562386.301883:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.302314:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126400 00000100:00100000:1.0:1783562386.302337:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126400 00000100:00100000:1.0:1783562386.302455:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562386.302469:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+46:10486:x1870200553126400:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562386.303186:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10486:x1870200553126400:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 713us (1317us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1783562386.303201:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00010000:00010000:3.0:1783562386.359338:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562386.370097:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.370813:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126528 00000100:00100000:2.0:1783562386.370845:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126528 00000100:00100000:2.0:1783562386.370952:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:2.0:1783562386.370967:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10496:x1870200553126528:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:2.0:1783562386.371109:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.371134:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.371180:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.371203:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.371212:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.371220:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372191:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372209:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372218:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562386.372290:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372309:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372316:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372324:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372349:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562386.372355:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372481:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372503:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562386.372507:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562386.372515:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372523:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b8856a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372543:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372550:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372558:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372564:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562386.372568:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372574:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372595:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562386.372598:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562386.372602:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372609:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372630:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372637:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372643:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372647:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1cc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562386.372650:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372655:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372662:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562386.372665:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562386.372669:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.372674:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.372926:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10496:x1870200553126528:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 1955us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.372941:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:0.0:1783562386.407045:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.407125:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126784 00000100:00100000:3.0:1783562386.407139:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126784 00000100:00100000:3.0:1783562386.407212:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:3.0:1783562386.407222:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+47:10499:x1870200553126784:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562386.407252:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562386.407281:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8857f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2131f expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407473:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407494:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407509:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407528:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407535:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407552:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407786:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407797:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407805:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562386.407817:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783562386.407980:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407988:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.407996:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408003:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562386.408008:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408017:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408032:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:3.0:1783562386.408036:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562386.408042:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408061:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408082:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408089:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408095:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408100:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562386.408104:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408110:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408118:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc89eae00) 00010000:00010000:3.0:1783562386.408121:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562386.408124:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408130:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b8858d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408188:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8857f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408204:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 49 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.408219:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:3.0:1783562386.408222:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562386.408224:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336600, rc 0) 00000100:00100000:3.0:1783562386.408310:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10499:x1870200553126784:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1088us (1284us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1783562386.408319:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:0.0:1783562386.415468:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.415550:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553126912 00000100:00100000:1.0:1783562386.415566:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553126912 00000100:00100000:1.0:1783562386.415660:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:1.0:1783562386.415674:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10499:x1870200553126912:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562386.415782:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415823:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415850:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415900:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415912:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415919:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415927:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.415932:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415941:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415958:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562386.415962:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562386.415968:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.415975:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b885a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.416077:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10499:x1870200553126912:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 406us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562386.416093:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:0.0:1783562386.418139:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.418238:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553127168 00000100:00100000:3.0:1783562386.418251:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553127168 00000100:00100000:3.0:1783562386.418441:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:3.0:1783562386.418457:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+49:10499:x1870200553127168:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:3.0:1783562386.419183:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10499:x1870200553127168:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 724us (1052us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1783562386.419194:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562386.485108:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.485183:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553127424 00000100:00100000:3.0:1783562386.485196:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553127424 00000100:00100000:3.0:1783562386.485649:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:3.0:1783562386.485663:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10509:x1870200553127424:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562386.485783:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562386.485788:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783562386.485887:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21303 expref: 50 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.485918:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:3.0:1783562386.485927:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562386.485948:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b885a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21326 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.486217:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.486235:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.486245:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.486294:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.486310:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 50 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.486328:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563620096:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562386.486631:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c816c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562386.489672:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563620096:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562386.490139:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.490983:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.491308:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553127552 00000100:00100000:3.0:1783562386.491326:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553127552 00010000:00010000:3.0:1783562386.491398:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 51 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.491562:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:3.0:1783562386.491577:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:2363:x1870200553127552:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562386.491604:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562386.491614:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 51 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491668:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 51 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491706:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2131f expref: 51 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491735:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:3.0:1783562386.491744:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491757:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491767:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.491882:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562386.491993:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:2363:x1870200553127552:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 418us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562386.492002:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00010000:00010000:2.0:1783562386.492093:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.492104:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562386.492132:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783562386.492386:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b885a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 51 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.492715:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.492722:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562386.492725:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562386.492727:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:2.0:1783562386.492779:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10509:x1870200553127424:12345-192.168.204.4@tcp:101:bash.0 Request processed in 7119us (7697us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783562386.492788:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:0.0:1783562386.495560:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.496027:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553127808 00000100:00100000:1.0:1783562386.496051:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553127808 00000100:00100000:1.0:1783562386.496647:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:1.0:1783562386.496668:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:10509:x1870200553127808:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:1.0:1783562386.497815:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.497862:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.497880:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562386.497949:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1783562386.497979:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033bafaf9 reply state 0000000083be5b33 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.497992:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562386.498276:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10509:x1870200553127808:12345-192.168.204.4@tcp:36:bash.0 Request processed in 1611us (2732us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783562386.498287:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00000020:00080000:1.0:1783562386.498295:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562386.501328:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501362:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501373:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501484:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562386.501491:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501504:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501537:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562386.501541:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562386.501550:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.501559:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b885be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562386.502335:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.502463:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553127936 00000100:00100000:2.0:1783562386.502489:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553127936 00000100:00100000:2.0:1783562386.502604:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:2.0:1783562386.502619:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10509:x1870200553127936:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562386.502659:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562386.502684:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b885c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2132d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.502937:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.502961:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 53 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.502974:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.503023:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 53 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.503039:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 53 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562386.503058:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563620224:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562386.503191:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562386.506166:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.506263:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563620224:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562386.506305:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.506558:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128064 00000100:00100000:1.0:1783562386.506570:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128064 00010000:00010000:1.0:1783562386.506630:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 54 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.506738:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:1.0:1783562386.506751:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef107480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:2364:x1870200553128064:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562386.506773:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562386.506784:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 54 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506809:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 54 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506866:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b885b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21326 expref: 54 pid: 5755 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506897:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562386.506904:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506920:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506930:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.506968:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562386.507057:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef107480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:2364:x1870200553128064:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 308us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562386.507068:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00010000:00010000:2.0:1783562386.507341:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.507351:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562386.507472:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783562386.507479:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562386.507511:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.507562:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b885c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 53 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.507583:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 52 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.507592:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562386.507595:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562386.507597:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d000, rc 0) 00000100:00100000:2.0:1783562386.507645:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10509:x1870200553127936:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5030us (5327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.507653:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:0.0:1783562386.511931:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.512119:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128320 00000100:00100000:1.0:1783562386.512245:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128320 00000100:00100000:1.0:1783562386.512324:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:1.0:1783562386.512341:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:10509:x1870200553128320:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:0.0:1783562386.515450:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10509:x1870200553128320:12345-192.168.204.4@tcp:35:bash.0 Request processed in 3064us (3486us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1783562386.515469:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1783562386.570287:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562386.570399:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128448 00000100:00100000:2.0:1783562386.570437:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128448 00000100:00100000:2.0:1783562386.570535:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:2.0:1783562386.570547:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+53:10515:x1870200553128448:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562386.570580:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562386.570628:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b885d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21334 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570719:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570740:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570758:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562386.570847:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1783562386.570852:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562386.570882:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570925:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b885d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21334 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570946:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21334 expref: 54 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.570956:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562386.570959:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562386.570963:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1da00, rc 0) 00000100:00100000:2.0:1783562386.571052:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553128448:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 506us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562386.571061:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:2.0:1783562386.576468:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562386.576548:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128576 00000100:00100000:0.0:1783562386.577327:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128576 00000100:00100000:0.0:1783562386.577584:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:0.0:1783562386.577598:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553128576:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562386.577648:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562386.577685:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b885e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2133b expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577824:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577855:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577869:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577886:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577892:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.577899:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578047:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578057:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578065:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562386.578112:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783562386.578117:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562386.578138:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578162:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578174:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578196:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578204:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578212:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562386.578220:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578228:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578246:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:0.0:1783562386.578258:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562386.578263:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578270:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b885e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578288:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578294:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578307:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578312:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562386.578315:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578321:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578330:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfce234e000) 00010000:00010000:0.0:1783562386.578332:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562386.578335:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578341:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b885ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578379:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b885e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2133b expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578396:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2133b expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.578423:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:0.0:1783562386.578425:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562386.578428:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562386.578525:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10515:x1870200553128576:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 929us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562386.578542:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:0.0:1783562386.582361:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.582875:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.583230:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128960 00000100:00100000:3.0:1783562386.583248:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128960 00000100:00100000:2.0:1783562386.583346:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553128704 00000100:00100000:2.0:1783562386.583351:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553128704 00000100:00100000:0.0:1783562386.583444:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:0.0:1783562386.583461:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:2361:x1870200553128704:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562386.583481:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562386.583513:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b885f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2133b expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.583536:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:0.0:1783562386.583545:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562386.583622:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:2361:x1870200553128704:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 164us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562386.584054:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:3.0:1783562386.584064:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10515:x1870200553128960:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562386.584093:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562386.584113:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b885fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21342 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.584260:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.584286:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 56 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.584295:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.584338:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 56 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.584366:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 56 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.584384:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563620352:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562386.584500:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c81f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562386.586624:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6707800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563620352:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562386.586674:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562386.587215:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562386.587435:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129088 00000100:00100000:3.0:1783562386.587443:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129088 00010000:00010000:3.0:1783562386.587491:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 57 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562386.587542:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:3.0:1783562386.587573:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:2363:x1870200553129088:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562386.587590:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562386.587599:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 57 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587611:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 57 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587637:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b885cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2132d expref: 57 pid: 5756 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587657:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:3.0:1783562386.587663:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587674:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587683:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562386.587721:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562386.587803:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:2363:x1870200553129088:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 231us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562386.587812:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:0.0:1783562386.587865:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00010000:00010000:2.0:1783562386.588610:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.588622:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562386.588647:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783562386.588956:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b885fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 56 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.588986:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 55 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562386.588994:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562386.588997:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562386.589000:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336600, rc 0) 00000100:00100000:2.0:1783562386.589107:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10515:x1870200553128960:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 5046us (6232us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783562386.589114:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:1.0:1783562386.592150:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562386.592345:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129344 00000100:00100000:0.0:1783562386.592358:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129344 00000100:00100000:0.0:1783562386.592551:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562386.592612:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10515:x1870200553129344:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:0.0:1783562386.592629:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562386.592665:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b88563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21318 expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.592686:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:0.0:1783562386.592690:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562386.592766:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553129344:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 206us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562386.592793:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562386.595734:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562386.595950:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129472 00000100:00100000:0.0:1783562386.595971:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129472 00000100:00100000:0.0:1783562386.596070:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:0.0:1783562386.596083:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553129472:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:0.0:1783562386.596229:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.596252:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562386.596324:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562386.596755:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783562386.596960:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553129472:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 875us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562386.596971:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:3.0:1783562386.599083:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562386.599174:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129600 00000100:00100000:1.0:1783562386.599186:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129600 00000100:00100000:1.0:1783562386.599555:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:1.0:1783562386.599566:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:10515:x1870200553129600:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562386.599595:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562386.599620:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21349 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599703:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599710:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599731:0:6572:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599742:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599759:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562386.599761:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562386.599765:0:6572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562386.599772:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498800, rc 0) 00000100:00100000:1.0:1783562386.599917:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10515:x1870200553129600:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 353us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562386.600177:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 111 00010000:00010000:1.0:1783562387.383027:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783562387.510739:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783562387.510758:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562387.510861:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1783562387.510871:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783562387.511112:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6342680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563620480:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783562387.512982:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1783562387.517316:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6342680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563620480:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562387.520130:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.522625:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129728 00000100:00100000:2.0:1783562387.522655:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129728 00000100:00100000:2.0:1783562387.522774:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:2.0:1783562387.522788:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10517:x1870200553129728:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562387.522887:0:5755:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562387.523145:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10517:x1870200553129728:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 359us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.523154:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:3.0:1783562387.528472:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.528597:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553129856 00000100:00100000:2.0:1783562387.528612:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553129856 00000100:00100000:2.0:1783562387.528696:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:2.0:1783562387.528715:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10517:x1870200553129856:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.528977:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529003:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529019:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529191:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529223:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529248:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529295:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529305:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529313:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562387.529380:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783562387.529461:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562387.529480:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529494:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529500:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529508:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529513:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.529519:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529526:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529542:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:2.0:1783562387.529545:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562387.529550:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529569:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88620 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529587:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529592:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529608:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529615:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.529617:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529623:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529632:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.529646:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562387.529649:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529655:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88627 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529677:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529683:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529690:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529695:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.529698:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529713:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529722:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562387.529724:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562387.529727:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.529733:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8862e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.529892:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10517:x1870200553129856:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 1175us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.529903:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:2.0:1783562387.535755:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.536085:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553130112 00000100:00100000:0.0:1783562387.536100:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553130112 00000100:00100000:0.0:1783562387.536454:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:0.0:1783562387.536467:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:10517:x1870200553130112:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562387.536500:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562387.536530:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88635 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21350 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.536700:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.536740:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.536758:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562387.536854:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783562387.537005:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537014:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537022:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537028:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562387.537033:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537042:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537058:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:0.0:1783562387.537061:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783562387.537067:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537088:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b8863c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537147:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88635 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21350 expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537166:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:0.0:1783562387.537170:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562387.537175:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88635 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21350 expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.537187:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562387.537496:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130112:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1030us (1756us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1783562387.537504:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:0.0:1783562387.547762:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.547897:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553130240 00000100:00100000:1.0:1783562387.547909:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553130240 00000100:00100000:1.0:1783562387.547985:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:1.0:1783562387.547999:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130240:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783562387.548051:0:6572:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783562387.548183:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130240:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.548191:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:3.0:1783562387.556168:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.556384:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553130496 00000100:00100000:1.0:1783562387.556399:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553130496 00000100:00100000:1.0:1783562387.556518:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:1.0:1783562387.556530:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130496:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562387.556560:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562387.556839:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783562387.556889:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b885da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21334 expref: 56 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.556922:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562387.556929:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562387.556976:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8864a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21357 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783562387.559193:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1783562387.559557:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.560716:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.560737:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.561013:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b8864a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21357 expref: 58 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.561047:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21357 expref: 57 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.561057:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562387.561061:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562387.561067:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499200, rc 0) 00000100:00100000:1.0:1783562387.561257:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10517:x1870200553130496:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 4726us (5105us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1783562387.561270:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:3.0:1783562387.568554:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.570941:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553130752 00000100:00100000:1.0:1783562387.570965:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553130752 00000100:00100000:1.0:1783562387.571072:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:1.0:1783562387.571085:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10517:x1870200553130752:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562387.571202:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562387.571238:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21357 expref: 57 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571263:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562387.571277:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562387.571306:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571323:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571509:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571528:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571537:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571544:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571715:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571723:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571730:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571745:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.571750:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571760:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571770:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562387.571773:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562387.571777:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571784:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b8865f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571793:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571799:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571806:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571822:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.571825:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571832:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571854:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3fd4ad9d (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562387.571857:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562387.571859:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.571866:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b88666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3fd4ad9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.571999:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130752:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 912us (3456us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562387.572008:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:0.0:1783562387.578196:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.579762:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553130880 00000100:00100000:2.0:1783562387.579861:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553130880 00000100:00100000:2.0:1783562387.579964:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:2.0:1783562387.579979:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:10517:x1870200553130880:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.580014:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562387.580048:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8866d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2135e expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580100:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580116:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580148:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580272:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8866d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580296:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.580307:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.580310:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562387.580315:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d200, rc 0) 00000100:00100000:2.0:1783562387.580485:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10517:x1870200553130880:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 509us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.580493:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:0.0:1783562387.586701:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.588230:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553131136 00000100:00100000:2.0:1783562387.588244:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553131136 00000100:00100000:2.0:1783562387.588319:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:2.0:1783562387.588329:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:10517:x1870200553131136:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.588757:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.588778:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.588790:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562387.590975:0:5754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1783562387.590994:0:5754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196847590878ns, next at 197847587288ns, rc = 0 00000004:00010000:2.0:1783562387.591359:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021a3d18b reply state 00000000631f96d3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.591376:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562387.591586:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10517:x1870200553131136:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 3244us (4884us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783562387.591595:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:0.0:1783562387.599444:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.599748:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553131264 00000100:00100000:2.0:1783562387.599762:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553131264 00000100:00100000:2.0:1783562387.599891:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 120 00000100:00100000:2.0:1783562387.599905:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10517:x1870200553131264:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.599937:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562387.599963:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21365 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.600043:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 60 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.600074:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 60 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.600096:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.600099:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562387.600103:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1dc00, rc 0) 00000100:00100000:2.0:1783562387.600195:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:10517:x1870200553131264:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 292us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.600202:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 120 00010000:00010000:1.0:1783562387.600744:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600757:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600765:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600772:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.600778:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600787:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600804:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:1.0:1783562387.600809:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562387.600824:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.600842:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b8867b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.603600:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.603981:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553131392 00000100:00100000:2.0:1783562387.604001:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553131392 00000100:00100000:2.0:1783562387.604106:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:2.0:1783562387.604123:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553131392:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783562387.604660:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553131392:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 541us (1075us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783562387.604670:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00080000:1.0:1783562387.604824:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562387.607874:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.607996:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553131648 00000100:00100000:0.0:1783562387.608009:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553131648 00000100:00100000:0.0:1783562387.608093:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:0.0:1783562387.608106:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:10517:x1870200553131648:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562387.608525:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:10517:x1870200553131648:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 418us (669us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1783562387.608535:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:0.0:1783562387.612077:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.612529:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553131904 00000100:00100000:1.0:1783562387.612547:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553131904 00000100:00100000:1.0:1783562387.612632:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 121 00000100:00100000:1.0:1783562387.612647:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:10517:x1870200553131904:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783562387.612912:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:10517:x1870200553131904:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 267us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.612923:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 121 00000100:00100000:1.0:1783562387.616616:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.616890:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132032 00000100:00100000:0.0:1783562387.616906:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132032 00000100:00100000:0.0:1783562387.617002:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:0.0:1783562387.617040:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:10517:x1870200553132032:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562387.617072:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562387.617109:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2136c expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617270:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617293:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617310:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562387.617483:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562387.617524:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617571:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2136c expref: 62 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617601:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2136c expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.617616:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:0.0:1783562387.617620:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783562387.617627:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562387.617805:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:10517:x1870200553132032:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 768us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562387.617840:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:3.0:1783562387.621756:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.622062:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132160 00000100:00100000:1.0:1783562387.622078:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132160 00000100:00100000:1.0:1783562387.622329:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:1.0:1783562387.622346:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553132160:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562387.622479:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562387.622513:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21373 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562387.622560:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f0092, blocks: 0x1 00010000:00010000:1.0:1783562387.622591:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=196s v=(0 0) 00010000:00010000:1.0:1783562387.622597:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562387.622610:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 10 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.622655:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 10 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.622673:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499a00, rc 0) 00000100:00100000:1.0:1783562387.622759:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2364:x1870200553132160:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 418us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.622768:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562387.627202:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.627394:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132416 00000100:00100000:1.0:1783562387.627464:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132416 00000100:00100000:1.0:1783562387.627942:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 123 00000100:00100000:1.0:1783562387.627956:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:10517:x1870200553132416:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783562387.628237:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:10517:x1870200553132416:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 281us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.628247:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 123 00000100:00100000:0.0:1783562387.636542:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.636648:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132544 00000100:00100000:3.0:1783562387.636668:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132544 00000100:00100000:3.0:1783562387.636756:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:3.0:1783562387.636771:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:10517:x1870200553132544:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562387.636801:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562387.636842:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2137a expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.636903:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 11 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.636913:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562387.636919:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562387.636924:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.636981:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 11 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.636997:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 11 pid: 6549 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.637017:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6f8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563620608:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562387.637161:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c81f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562387.641787:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.641868:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132672 00000100:00100000:0.0:1783562387.641879:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132672 00010000:00010000:0.0:1783562387.641964:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 12 pid: 6549 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.642026:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:0.0:1783562387.642044:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2364:x1870200553132672:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562387.642078:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562387.642136:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 12 pid: 6549 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.642156:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 12 pid: 6549 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.642202:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562387.642208:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562387.642218:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.642233:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.642297:0:5739:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.642342:0:5739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1870200563620736:192.168.204.4@tcp:105: 00010000:00010000:3.0:1783562387.642550:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d18331/0x4738ba0933b88697 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21373 expref: 12 pid: 6549 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.642572:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6f8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563620608:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562387.642615:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.642629:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336000, rc 0) 00000100:00100000:0.0:1783562387.642698:0:5739:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562387.642877:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:10517:x1870200553132544:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 6107us (6354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562387.642889:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:3.0:1783562387.645884:0:5739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1870200563620736:192.168.204.4@tcp:105: 00010000:00010000:3.0:1783562387.645933:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562387.646028:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2364:x1870200553132672:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 3986us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562387.646045:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:1.0:1783562387.647296:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.647490:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132800 00000100:00100000:2.0:1783562387.647509:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132800 00002000:00100000:2.0:1783562387.647601:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bfcf6343800 x1870200553132800/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:228/0 lens 504/0 e 0 to 0 dl 1783562398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562387.647616:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6343800 with x1870200553132800 ext(0->12) 00002000:00010000:2.0:1783562387.647623:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6343800 00000100:00100000:2.0:1783562387.647668:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:2.0:1783562387.647680:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2364:x1870200553132800:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783562387.648642:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2364:x1870200553132800:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 958us (1361us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783562387.648653:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00002000:00100000:2.0:1783562387.648662:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bfcf6343800 x1870200553132800/t4294967308(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:228/0 lens 504/448 e 0 to 0 dl 1783562398 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562387.648679:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6343800 with x1870200553132800 ext(0->12) 00002000:00010000:2.0:1783562387.648684:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6343800 00000100:00100000:2.0:1783562387.651896:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.652035:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553132928 00000100:00100000:1.0:1783562387.652055:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553132928 00000100:00100000:1.0:1783562387.652232:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 124 00000100:00100000:1.0:1783562387.652247:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:10517:x1870200553132928:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783562387.691435:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:10517:x1870200553132928:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 39132us (39497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.691464:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 124 00000001:00080000:3.0:1783562387.691921:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1783562387.691966:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1783562387.692016:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfbc1082180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783562387.692022:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6652e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfbc10826c0 00000020:00080000:3.0:1783562387.692026:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6652900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc6794400 00000020:00080000:2.0:1783562387.692158:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:3.0:1783562387.692197:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783562387.692271:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcd21a3240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783562387.692275:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6653c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc3e229c0 00000020:00080000:3.0:1783562387.692278:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6653a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfceee2b400 00000020:00080000:3.0:1783562387.692322:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783562387.692473:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1783562387.692633:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562387.692681:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563621120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783562387.692797:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562387.692906:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563621120 00000020:00080000:2.0:1783562387.692913:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1783562387.692921:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563621120 00000100:00100000:3.0:1783562387.692982:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563620864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783562387.692993:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562387.693005:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3275:x1870200563621120:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783562387.693025:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1783562387.693054:0:6550:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:3.0:1783562387.693061:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562387.693069:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563620992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783562387.693094:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1783562387.693124:0:6550:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4f0090, atime: 0x6a4f0091, ctime: 0x6a4f0090, blocks: 0x1 00000100:00100000:3.0:1783562387.693131:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563620864 00000100:00100000:3.0:1783562387.693136:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563620864 00010000:00010000:1.0:1783562387.693137:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.693165:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=196s v=(0 0) 00010000:00010000:1.0:1783562387.693171:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783562387.693180:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563620992 00010000:00010000:1.0:1783562387.693180:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.693186:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563620992 00000100:00100000:3.0:1783562387.693206:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1783562387.693209:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.693216:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563620864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783562387.693229:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783562387.693236:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1783562387.693240:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.693260:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.693275:0:6550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562387.693282:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 11 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.693292:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783562387.693296:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783562387.693301:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.693341:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 11 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.693376:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 11 pid: 6547 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.693392:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563621248:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562387.693502:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c816c0 going to sleep for 11 seconds 00000100:00080000:3.0:1783562387.693524:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783562387.693553:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562387.693563:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.693573:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562387.693577:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.693636:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.693712:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.693722:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d18331/0x4738ba0933b886a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.693752:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562387.693754:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562387.693757:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562387.694001:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3275:x1870200563621120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 996us (1203us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783562387.694012:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562387.694038:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783562387.694047:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563620992:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1783562387.694052:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf637ed80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783562387.694063:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563621120:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1783562387.694180:0:6550:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783562387.694184:0:6550:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783562386 00002000:00010000:1.0:1783562387.694187:0:6550:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783562387.694196:0:6550:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783562386 -> 1783562386 00002000:00010000:1.0:1783562387.694199:0:6550:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783562387.694234:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3272:x1870200563620992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (1139us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783562387.694241:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1783562387.694279:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf6340a80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1783562387.694288:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563620992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783562387.695032:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.695085:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133056 00000100:00100000:0.0:1783562387.695095:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133056 00000100:00100000:0.0:1783562387.695148:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:0.0:1783562387.695157:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2363:x1870200553133056:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783562387.699451:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6639f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563621248:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562387.699509:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.699595:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.699634:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133184 00000100:00100000:3.0:1783562387.699644:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133184 00010000:00010000:3.0:1783562387.699694:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 13 pid: 6547 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.699772:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:1.0:1783562387.699787:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:2363:x1870200553133184:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562387.699817:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562387.699826:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 13 pid: 6547 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.699845:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 13 pid: 6547 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.699878:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212d9 expref: 13 pid: 6547 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.699914:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562387.699920:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562387.699928:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.699940:0:5740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.699968:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562387.699998:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.700010:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.700037:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.700046:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2363:x1870200553133184:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 261us (450us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562387.700048:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.700063:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00010000:00010000:3.0:1783562387.700078:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562387.700456:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562387.700467:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.700477:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562387.700483:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.700493:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.700507:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.700516:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.700535:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562387.700538:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562387.700539:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562387.701209:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3272:x1870200563620864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7987us (8176us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783562387.701223:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1783562387.701253:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf6342300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783562387.701266:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563620864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783562387.718251:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:2363:x1870200553133056:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 23068us (23202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.718272:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000001:00080000:3.0:1783562387.718375:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1783562387.718394:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1783562387.718420:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1783562387.723318:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.723626:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133440 00000100:00100000:2.0:1783562387.723643:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133440 00000100:00100000:2.0:1783562387.723805:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 125 00000100:00100000:2.0:1783562387.723831:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10517:x1870200553133440:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.723942:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562387.723988:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2136c expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.724021:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.724028:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562387.724176:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.724228:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.724243:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562387.725172:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a188b47 reply state 000000001cac0887 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.725386:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562387.725847:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:10517:x1870200553133440:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 2014us (2543us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783562387.725859:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 125 00000100:00100000:2.0:1783562387.733070:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.733181:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133568 00000100:00100000:3.0:1783562387.733198:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133568 00000100:00100000:3.0:1783562387.733322:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:3.0:1783562387.733334:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553133568:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1783562387.733673:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733691:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733701:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733707:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.733713:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733723:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733751:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:1.0:1783562387.733755:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562387.733762:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.733769:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b886b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562387.733948:0:6550:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783562387.733952:0:6550:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783562386 -> 1783562385 00002000:00010000:3.0:1783562387.733955:0:6550:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783562385 00002000:00010000:3.0:1783562387.733958:0:6550:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783562386 -> 1783562385 00002000:00010000:3.0:1783562387.733960:0:6550:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783562387.734050:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553133568:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 717us (1002us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783562387.734088:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:1.0:1783562387.737695:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.737797:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133824 00000100:00100000:0.0:1783562387.737951:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133824 00000100:00100000:0.0:1783562387.738035:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 126 00000100:00100000:0.0:1783562387.738048:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10517:x1870200553133824:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783562387.738165:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.738188:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.738212:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.738269:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.738288:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 15 pid: 5755 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.738310:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563621376:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562387.738581:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6ec16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562387.743325:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563621376:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562387.743397:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.743974:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.744029:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553133952 00000100:00100000:0.0:1783562387.744041:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553133952 00010000:00010000:0.0:1783562387.744099:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 16 pid: 5755 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.744180:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:0.0:1783562387.744193:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:2363:x1870200553133952:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562387.744232:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562387.744242:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 16 pid: 5755 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744257:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 16 pid: 5755 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744289:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2135e expref: 16 pid: 5755 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744309:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:0.0:1783562387.744314:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744324:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744334:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.744377:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562387.744482:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744491:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744539:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744548:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744556:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744562:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.744569:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744579:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744592:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:1.0:1783562387.744595:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783562387.744599:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.744606:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b886ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.744670:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:10517:x1870200553133824:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 6624us (7002us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783562387.744708:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 126 00000100:00100000:0.0:1783562387.744954:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2363:x1870200553133952:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 762us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562387.744962:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:1.0:1783562387.747598:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.748263:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134080 00000100:00100000:3.0:1783562387.748287:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134080 00000100:00100000:3.0:1783562387.748399:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:3.0:1783562387.748455:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553134080:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783562387.748541:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.748576:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.748588:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783562387.748594:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783562387.748600:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.748657:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.748675:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 7 pid: 6608 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.748695:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563621504:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562387.748838:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3c81f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562387.752213:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6608:1870200563621504:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562387.752358:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.753307:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.753859:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134208 00000100:00100000:3.0:1783562387.753872:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134208 00010000:00010000:2.0:1783562387.754022:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 8 pid: 6608 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.754115:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:2.0:1783562387.754127:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553134208:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562387.754147:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562387.754175:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 8 pid: 6608 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.754191:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 8 pid: 6608 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.754225:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a65c34e8/0x4738ba0933b8869e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2137a expref: 8 pid: 6608 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.754272:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562387.754278:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562387.754286:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.754298:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.754384:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562387.754499:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553134208:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 374us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.754509:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00010000:00010000:0.0:1783562387.755002:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755026:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755062:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755073:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755083:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755091:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562387.755096:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755105:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755120:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.755129:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001884dfdb/0x4738ba0933b886c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.755237:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2363:x1870200553134080:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 6775us (7646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562387.755249:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:1.0:1783562387.758069:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.758182:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134464 00000100:00100000:2.0:1783562387.758195:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134464 00000100:00100000:2.0:1783562387.758384:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 127 00000100:00100000:2.0:1783562387.758397:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10517:x1870200553134464:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783562387.758543:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.758578:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.758594:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.759301:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.759446:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.759456:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.759514:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.759533:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 15 pid: 5756 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.759555:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563621632:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562387.760036:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562387.765306:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.765602:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563621632:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562387.765645:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562387.766001:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134592 00000100:00100000:3.0:1783562387.766014:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134592 00010000:00010000:2.0:1783562387.768524:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 16 pid: 5756 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.768590:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:2.0:1783562387.768610:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:2363:x1870200553134592:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562387.768636:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562387.768646:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 16 pid: 5756 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768731:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 16 pid: 5756 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768869:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21365 expref: 16 pid: 5756 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768896:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.768903:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768917:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768928:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.768973:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562387.769201:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.769212:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.769603:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:2363:x1870200553134592:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 998us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.769615:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000001:00080000:1.0:1783562387.769878:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1783562387.770125:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1783562387.770183:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1783562387.770303:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563621760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783562387.770445:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562387.770486:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562387.770904:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563621760 00000100:00100000:2.0:1783562387.770914:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563621760 00000100:00100000:2.0:1783562387.770978:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562387.770989:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6572:x1870200563621760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783562387.771094:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6572:x1870200563621760:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.771114:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783562387.771964:0:6572:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1783562387.771974:0:6572:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1783562387.772012:0:6572:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf6340a80, transno 4294967309 00000100:00100000:1.0:1783562387.772079:0:6572:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfcf6342300 x1870200563620864/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783562403 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562387.772096:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563621760:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1783562387.772871:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1783562387.773008:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563621888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783562387.773110:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562387.773162:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1783562387.773523:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563621888 00000100:00100000:3.0:1783562387.773535:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563621888 00000100:00100000:3.0:1783562387.773611:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783562387.773623:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6572:x1870200563621888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783562387.774093:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6572:x1870200563621888:12345-0@lo:1000:mdt00_003.0 Request processed in 470us (980us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783562387.774113:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562387.774367:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6572:1870200563621888:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783562387.774533:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774568:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774578:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774585:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.774592:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774604:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774628:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.774632:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562387.774640:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774647:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774846:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774855:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774861:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774866:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.774877:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774884:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774895:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562387.774898:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562387.774907:0:6572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774922:0:6572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774935:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.774984:0:6572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.775003:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563622016:192.168.204.4@tcp:105: 00000100:00100000:2.0:1783562387.775488:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25900 going to sleep for 11 seconds 00000100:00100000:1.0:1783562387.779509:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563622016:192.168.204.4@tcp:105: 00010000:00010000:1.0:1783562387.779569:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779587:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9600/0x4738ba0933b88612 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779634:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779654:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779684:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779700:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779707:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779714:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779720:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.779725:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779762:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779781:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562387.779785:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562387.779790:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779797:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b886d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779823:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779830:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779837:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779842:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562387.779845:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779851:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779860:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562387.779867:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783562387.779871:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.779888:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b886c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.780098:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.780243:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134720 00000100:00100000:3.0:1783562387.780253:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134720 00000100:00100000:1.0:1783562387.780255:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10517:x1870200553134464:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 21859us (22201us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1783562387.780270:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 127 00000020:00080000:1.0:1783562387.780279:0:6572:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783562387.780328:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:3.0:1783562387.780347:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10515:x1870200553134720:12345-192.168.204.4@tcp:49:lfs.0 00000040:00080000:2.0:1783562387.780607:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562387.780622:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783562387.780750:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10515:x1870200553134720:12345-192.168.204.4@tcp:49:lfs.0 Request processed in 410us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562387.780757:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000040:00080000:2.0:1783562387.782940:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783562387.782964:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783562387.783792:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562387.783870:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.783990:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553135232 00000100:00100000:3.0:1783562387.784004:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553135232 00000100:00100000:3.0:1783562387.784083:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562387.784096:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5196850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:10517:x1870200553135232:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783562387.785364:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553134976 00000100:00100000:2.0:1783562387.785374:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553134976 00000100:00100000:2.0:1783562387.785634:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 128 00000100:00100000:2.0:1783562387.785655:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10515:x1870200553134976:12345-192.168.204.4@tcp:58:lfs.0 00000040:00080000:2.0:1783562387.786042:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783562387.786149:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10515:x1870200553134976:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 495us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.786158:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 128 00000004:00080000:0.0:1783562387.787837:0:5758:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783562387.788002:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1783562387.788102:0:5758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788122:0:5758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788139:0:5758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788149:0:5758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788157:0:5758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788164:0:5758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562387.788204:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562387.788431:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562387.788440:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.788448:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562387.788463:0:8323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.788472:0:8323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.788487:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bfce234ea00) 00010000:00010000:3.0:1783562387.788490:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783562387.788495:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.788501:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b886dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562387.788525:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562387.788526:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562387.788528:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562387.788735:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5196850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10517:x1870200553135232:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 4635us (4857us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1783562387.788748:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000020:00080000:0.0:1783562387.788756:0:5758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783562387.813446:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562387.813562:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553135360 00000100:00100000:3.0:1783562387.813578:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553135360 00000100:00100000:2.0:1783562387.813759:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 129 00000100:00100000:2.0:1783562387.813774:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:10520:x1870200553135360:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562387.813802:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562387.813839:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21381 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.813930:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.813945:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814079:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814093:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814099:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814105:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814666:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814689:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 21 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814700:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814745:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 21 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.814763:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 21 pid: 5754 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562387.814781:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563622144:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562387.814936:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562387.819136:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562387.819251:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563622144:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562387.819286:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562387.819959:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553135616 00000100:00100000:0.0:1783562387.819973:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553135616 00000100:00100000:0.0:1783562387.820087:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562387.820107:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:5570:x1870200553135616:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783562387.820627:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:5570:x1870200553135616:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 523us (1515us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1783562387.820639:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562387.824200:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562387.824709:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553135744 00000100:00100000:1.0:1783562387.824733:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553135744 00010000:00010000:1.0:1783562387.824971:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 23 pid: 5754 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.825038:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:1.0:1783562387.825052:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:2364:x1870200553135744:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562387.825079:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562387.825090:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 23 pid: 5754 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825107:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 23 pid: 5754 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825206:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88604 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21342 expref: 23 pid: 5754 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825239:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562387.825246:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825287:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825297:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562387.825532:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562387.825560:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825589:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562387.825666:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:2364:x1870200553135744:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 615us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.825681:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000004:00200000:2.0:1783562387.825699:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783562387.825710:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562387.825750:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825832:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825849:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825864:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825873:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825882:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.825888:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825898:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825924:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:2.0:1783562387.825929:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562387.825937:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825946:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b886eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825988:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.825996:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826009:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826014:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562387.826018:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826023:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826032:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562387.826036:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562387.826046:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826051:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b886f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826116:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b886e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21381 expref: 22 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826134:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21381 expref: 21 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562387.826142:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562387.826144:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562387.826147:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c000, rc 0) 00000100:00100000:2.0:1783562387.826274:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10520:x1870200553135360:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 12502us (12871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.826295:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 129 00000100:00100000:0.0:1783562387.830887:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563622272:0@lo:400:kworker.0 00000100:00100000:0.0:1783562387.831012:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562387.831235:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563622656:0@lo:400:kworker.0 00000100:00100000:2.0:1783562387.831276:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562387.831342:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622656 00000100:00100000:2.0:1783562387.831355:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622656 00000100:00100000:2.0:1783562387.831459:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783562387.831473:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3274:x1870200563622656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562387.831553:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3274:x1870200563622656:12345-0@lo:400:kworker.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.831562:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783562387.831620:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563622656:0@lo:400:kworker.0 00000100:00100000:3.0:1783562387.831729:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622272 00000100:00100000:3.0:1783562387.831734:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622272 00000100:00100000:3.0:1783562387.831780:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783562387.831788:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563622272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832129:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563622528:0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832174:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562387.832203:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562387.832210:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563622400:0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832235:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562387.832275:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622528 00000100:00100000:1.0:1783562387.832280:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622528 00000100:00100000:1.0:1783562387.832343:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622400 00000100:00100000:1.0:1783562387.832346:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622400 00000100:00100000:1.0:1783562387.832368:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783562387.832376:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563622528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832435:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563622528:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.832443:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783562387.832456:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783562387.832462:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563622400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832490:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563622400:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562387.832511:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1783562387.832529:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562387.832556:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563622400:0@lo:400:kworker.0 00000100:00100000:1.0:1783562387.832567:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563622528:0@lo:400:kworker.0 00000100:00100000:2.0:1783562387.832732:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562387.832741:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563622784:0@lo:400:kworker.0 00000100:00100000:2.0:1783562387.832773:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562387.832821:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622784 00000100:00100000:2.0:1783562387.832825:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622784 00000100:00100000:2.0:1783562387.832854:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783562387.832859:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563622784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562387.832892:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563622784:12345-0@lo:400:kworker.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562387.832898:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783562387.832919:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563622784:0@lo:400:kworker.0 00000100:00080000:1.0:1783562387.832983:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562387.833135:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563622272:12345-0@lo:400:kworker.0 Request processed in 1346us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562387.833144:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783562387.833216:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563622272:0@lo:400:kworker.0 00000100:00100000:3.0:1783562388.342612:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783562388.342635:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563622912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562388.342706:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562388.342918:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563622912 00000100:00100000:2.0:1783562388.342927:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563622912 00000100:00100000:0.0:1783562388.342944:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562388.342955:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563623040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562388.342993:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783562388.342993:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562388.343014:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563622912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562388.343020:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623040 00000100:00100000:0.0:1783562388.343024:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623040 00002000:00000024:2.0:1783562388.343045:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1783562388.343057:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783562388.343063:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3272:x1870200563623040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562388.343095:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563622912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (389us total) trans 0 rc 0/0 00002000:00000024:0.0:1783562388.343100:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562388.343102:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783562388.343131:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3272:x1870200563623040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562388.343152:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1783562388.343173:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562388.343233:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563623040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562388.343554:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf70d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563622912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783562388.406529:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562388.409886:0:11859:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562388.409898:0:11859:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562388.409955:0:11859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783562388.409961:0:11859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783562388.790767:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562388.790779:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562388.790882:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783562388.790893:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783562388.791117:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563623168:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562388.791288:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceec25000 going to sleep for 11 seconds 00000100:00100000:1.0:1783562388.796313:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562388.797253:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563623168:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562388.798878:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553135872 00000100:00100000:0.0:1783562388.798896:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553135872 00000100:00100000:0.0:1783562388.799011:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 130 00000100:00100000:0.0:1783562388.799023:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10532:x1870200553135872:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562388.799061:0:6572:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1783562388.799359:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562388.801127:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10532:x1870200553135872:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 2089us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562388.801145:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 130 00000100:00100000:0.0:1783562388.809218:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562388.809329:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553136128 00000100:00100000:1.0:1783562388.809341:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553136128 00000100:00100000:3.0:1783562388.809433:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 131 00000100:00100000:3.0:1783562388.809448:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:10532:x1870200553136128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562388.809472:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562388.809495:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88700 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21388 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562388.809615:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562388.809633:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562388.809650:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562388.809663:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783562388.809851:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88700 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21388 expref: 24 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562388.809877:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21388 expref: 23 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562388.809887:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:3.0:1783562388.809890:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562388.809895:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:3.0:1783562388.810204:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:10532:x1870200553136128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 758us (997us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1783562388.810211:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 131 00000100:00100000:3.0:1783562388.817772:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562388.817850:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562388.817861:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553136512 00000100:00100000:2.0:1783562388.817880:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553136512 00000100:00100000:0.0:1783562388.817952:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553136384 00000100:00100000:0.0:1783562388.817969:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553136384 00000100:00100000:0.0:1783562388.818058:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:0.0:1783562388.818069:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd00fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2362:x1870200553136384:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562388.818094:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562388.818127:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21388 expref: 24 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562388.818147:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 132 00000100:00100000:2.0:1783562388.818162:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:10532:x1870200553136512:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783562388.818175:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:0.0:1783562388.818183:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562388.818264:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd00fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:2362:x1870200553136384:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 193us (409us total) trans 0 rc 0/0 00010000:00010000:2.0:1783562388.818269:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562388.818281:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:2.0:1783562388.818312:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818329:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818660:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818687:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818695:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818702:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562388.818708:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818718:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818732:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562388.818735:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562388.818740:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562388.818746:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562388.818947:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:10532:x1870200553136512:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 787us (1193us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783562388.818957:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 132 00000040:00080000:2.0:1783562388.819350:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562388.819357:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562388.819890:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783562388.819906:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562388.821647:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562388.825046:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553136768 00000100:00100000:0.0:1783562388.825065:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553136768 00000100:00100000:0.0:1783562388.825213:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:0.0:1783562388.825225:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:10532:x1870200553136768:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562388.825543:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:10532:x1870200553136768:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 317us (3905us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783562388.825552:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000001:00080000:3.0:1783562389.409994:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1783562389.410024:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1783562389.410035:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1783562389.430812:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562389.950905:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562389.951013:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562389.951058:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562389.951085:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562389.951146:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562389.951190:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137408 00000100:00100000:3.0:1783562389.951207:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137408 00000100:00100000:3.0:1783562389.951310:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137024 00000100:00100000:3.0:1783562389.951314:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137024 00000100:00100000:3.0:1783562389.951345:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:3.0:1783562389.951360:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553137408:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562389.951535:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553137408:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 177us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562389.951545:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:3.0:1783562389.951573:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:3.0:1783562389.951580:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2361:x1870200553137024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562389.951616:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2361:x1870200553137024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562389.951624:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:3.0:1783562389.951648:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137152 00000100:00100000:3.0:1783562389.951653:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137152 00000100:00100000:3.0:1783562389.951705:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137280 00000100:00100000:3.0:1783562389.951709:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137280 00000100:00100000:3.0:1783562389.951735:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:3.0:1783562389.951742:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553137152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562389.951753:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553136896 00000100:00100000:2.0:1783562389.951761:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553136896 00000100:00100000:3.0:1783562389.951784:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553137152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562389.951793:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:3.0:1783562389.951810:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:3.0:1783562389.951818:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553137280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562389.951828:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 261 00000100:00100000:2.0:1783562389.951839:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553136896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562389.951853:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553137280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562389.951861:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:2.0:1783562389.951882:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553136896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562389.951891:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 261 00000100:00080000:1.0:1783562389.952162:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783562389.952170:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562389.952173:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1783562390.037016:0:11911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562390.037033:0:11911:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562390.037096:0:11911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783562390.037104:0:11911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562390.159025:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562390.159239:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137664 00000100:00100000:2.0:1783562390.159252:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137664 00000100:00080000:0.0:1783562390.159400:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562390.159584:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 133 00000100:00100000:2.0:1783562390.159600:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:10552:x1870200553137664:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562390.159626:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562390.159658:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8871c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2138f expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562390.159831:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88723 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562390.159852:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88723 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562390.159888:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88723 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562390.159918:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783562390.160524:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8871c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2138f expref: 27 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562390.160549:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88723 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2138f expref: 26 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562390.160577:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:2.0:1783562390.160580:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783562390.160585:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1cc00, rc 0) 00000100:00100000:2.0:1783562390.160675:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:10552:x1870200553137664:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1078us (1669us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783562390.160684:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 133 00000100:00100000:3.0:1783562390.166868:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562390.166983:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137792 00000100:00100000:1.0:1783562390.167001:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137792 00000100:00100000:1.0:1783562390.167079:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 134 00000100:00100000:1.0:1783562390.167093:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:10552:x1870200553137792:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562390.167210:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167234:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167250:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167285:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167292:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167311:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167318:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562390.167324:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167332:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167347:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562390.167351:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562390.167357:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562390.167364:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b88731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562390.167505:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:10552:x1870200553137792:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 414us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562390.167517:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 134 00000100:00100000:3.0:1783562390.225899:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562390.226023:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553137920 00000100:00100000:0.0:1783562390.226035:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553137920 00000100:00100000:0.0:1783562390.226102:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:0.0:1783562390.226113:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553137920:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562390.226133:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562390.226177:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b88738 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21396 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562390.226225:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4f0091, atime: 0x6a4f0091, ctime: 0x6a4f0091, blocks: 0xb 00010000:00010000:0.0:1783562390.226249:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=199s v=(0 0) 00010000:00010000:0.0:1783562390.226254:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562390.226265:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b88738 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21396 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562390.226288:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b88738 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21396 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562390.226302:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9600, rc 0) 00000100:00100000:0.0:1783562390.226381:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2362:x1870200553137920:12345-192.168.204.4@tcp:101:cat.0 Request processed in 269us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562390.226391:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:1.0:1783562390.230785:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562390.230933:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138048 00000100:00100000:2.0:1783562390.230946:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138048 00002000:00100000:2.0:1783562390.231012:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bfcf6686a00 x1870200553138048/t0(0) o3->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:231/0 lens 488/0 e 0 to 0 dl 1783562401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562390.231026:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6686a00 with x1870200553138048 ext(0->4095) 00002000:00010000:2.0:1783562390.231034:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6686a00 00000100:00100000:2.0:1783562390.231076:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:2.0:1783562390.231091:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553138048:12345-192.168.204.4@tcp:3:cat.0 00000100:00100000:2.0:1783562390.231345:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553138048:12345-192.168.204.4@tcp:3:cat.0 Request processed in 257us (584us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783562390.231353:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00002000:00100000:2.0:1783562390.231360:0:6555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bfcf6686a00 x1870200553138048/t0(0) o3->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:231/0 lens 488/4536 e 0 to 0 dl 1783562401 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562390.231368:0:6555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6686a00 with x1870200553138048 ext(0->4095) 00002000:00010000:2.0:1783562390.231371:0:6555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6686a00 00010000:00010000:0.0:1783562390.454679:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562391.478770:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562391.928988:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562391.929002:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562391.929038:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783562391.929047:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783562392.502886:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562392.954166:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563623680:0@lo:400:kworker.0 00000100:00100000:3.0:1783562392.954287:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562392.954378:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783562392.954389:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563623552:0@lo:400:kworker.0 00000100:00100000:3.0:1783562392.954516:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562392.955382:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563623424:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.955459:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562392.955492:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563623936:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.955745:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562392.955789:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783562392.955800:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563623296:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.955849:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562392.955879:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563623808:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.955910:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562392.956161:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623680 00000100:00100000:3.0:1783562392.956172:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623680 00000100:00100000:3.0:1783562392.956234:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623936 00000100:00100000:3.0:1783562392.956238:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623936 00000100:00100000:3.0:1783562392.956269:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783562392.956282:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563623680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562392.956369:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563623680:12345-0@lo:400:kworker.0 Request processed in 90us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562392.956379:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783562392.956433:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783562392.956443:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563623936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.956491:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623296 00000100:00100000:0.0:1783562392.956497:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623296 00000100:00100000:0.0:1783562392.956751:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783562392.956761:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563623296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.956809:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3275:x1870200563623296:12345-0@lo:400:kworker.0 Request processed in 51us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562392.956817:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783562392.956859:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623552 00000100:00100000:0.0:1783562392.956864:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623552 00000100:00100000:0.0:1783562392.956902:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623424 00000100:00100000:0.0:1783562392.956906:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623424 00000100:00100000:3.0:1783562392.956911:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783562392.956921:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000100:00100000:0.0:1783562392.956924:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563623808 00000100:00100000:0.0:1783562392.956929:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563623808 00000004:00080000:3.0:1783562392.956949:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf6706d80, transno 4294967301 00000100:00100000:0.0:1783562392.956953:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783562392.956963:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563623552:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1783562392.956965:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1783562392.956987:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf637ed80, transno 4294967304 00000100:00100000:3.0:1783562392.956997:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563623680:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.957009:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563623552:12345-0@lo:400:kworker.0 Request processed in 46us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562392.957017:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783562392.957024:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563623552:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.957038:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783562392.957047:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562392.957083:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563623936:12345-0@lo:400:kworker.0 Request processed in 641us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562392.957093:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783562392.957095:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563623424:12345-0@lo:400:kworker.0 Request processed in 46us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562392.957105:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783562392.957123:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783562392.957596:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563623808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.957639:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563623808:12345-0@lo:400:kworker.0 Request processed in 47us (1729us total) trans 0 rc 0/0 00000100:00080000:1.0:1783562392.959204:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783562392.959218:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783562392.959221:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562392.959632:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783562392.959744:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563623296:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.959776:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563623808:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.959793:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563623424:0@lo:400:kworker.0 00000100:00100000:0.0:1783562392.959812:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563623936:0@lo:400:kworker.0 00000001:00080000:3.0:1783562392.998202:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1783562392.998228:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc52a2e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783562392.998233:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6651500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc52a29c0 00000020:00080000:3.0:1783562392.998236:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcf6651300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfceee04c00 00000001:00080000:3.0:1783562392.998259:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1783562392.998279:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1783562392.998595:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1783562392.998906:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1783562393.000739:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1783562393.000756:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1783562393.000761:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1783562393.219336:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562393.220471:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138176 00000100:00100000:2.0:1783562393.220495:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138176 00000100:00080000:1.0:1783562393.220758:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562393.220840:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 135 00000100:00100000:3.0:1783562393.220857:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10205:x1870200553138176:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783562393.221062:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10205:x1870200553138176:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 Request processed in 209us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562393.221070:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 135 00000100:00100000:3.0:1783562393.227564:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562393.227951:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138432 00000100:00100000:0.0:1783562393.227972:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138432 00000100:00100000:0.0:1783562393.228117:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:0.0:1783562393.228132:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:10205:x1870200553138432:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562393.229175:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:10205:x1870200553138432:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1042us (1626us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1783562393.229188:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:1.0:1783562393.396171:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562393.396259:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138560 00000100:00100000:0.0:1783562393.396275:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138560 00000100:00100000:0.0:1783562393.396382:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 136 00000100:00100000:0.0:1783562393.396396:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:11003:x1870200553138560:12345-192.168.204.4@tcp:101:lsof.0 00000100:00080000:2.0:1783562393.396586:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783562393.396735:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562393.396886:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8873f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2139d expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397100:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397115:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397131:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562393.397589:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783562393.397596:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562393.397801:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397849:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8873f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 7 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397871:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 6 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562393.397882:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:0.0:1783562393.397884:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562393.398083:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562393.398209:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:11003:x1870200553138560:12345-192.168.204.4@tcp:101:lsof.0 Request processed in 1813us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562393.398220:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 136 00000100:00100000:0.0:1783562393.463396:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562393.463515:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562393.463751:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563624064 00000100:00100000:3.0:1783562393.463761:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563624064 00000100:00100000:3.0:1783562393.463831:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783562393.463845:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563624064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562393.463860:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783562393.463872:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563624192:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562393.463887:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562393.463905:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562393.463943:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563624192 00000100:00100000:2.0:1783562393.463948:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563624192 00000100:00100000:3.0:1783562393.463954:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563624064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562393.463963:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783562393.463978:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783562393.463988:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563624192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783562393.464010:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562393.464040:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000100:00100000:2.0:1783562393.464046:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563624192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000004:00080000:3.0:1783562393.464048:0:3272:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf6342300, transno 4294967310 00000100:00100000:2.0:1783562393.464058:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1783562393.464065:0:3272:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1783562393.464103:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562393.464135:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563624192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783562393.527376:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562394.551935:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562395.071254:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562395.071594:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562395.071689:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562395.071720:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562395.071724:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138688 00000100:00100000:2.0:1783562395.071739:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138688 00000100:00100000:0.0:1783562395.071755:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562395.071800:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138816 00000100:00100000:3.0:1783562395.071806:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138816 00000100:00100000:2.0:1783562395.071818:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 263 00000100:00100000:2.0:1783562395.071833:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2363:x1870200553138688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562395.071869:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139200 00000100:00100000:3.0:1783562395.071874:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139200 00000100:00100000:3.0:1783562395.071904:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:3.0:1783562395.071913:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2364:x1870200553138816:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562395.071924:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2363:x1870200553138688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 92us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562395.071934:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 263 00000100:00100000:3.0:1783562395.071975:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:2364:x1870200553138816:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00080000:2.0:1783562395.071979:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562395.072011:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:3.0:1783562395.072034:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:3.0:1783562395.072043:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2363:x1870200553139200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562395.072074:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2363:x1870200553139200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562395.072081:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:1.0:1783562395.072576:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553138944 00000100:00100000:1.0:1783562395.072588:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553138944 00000100:00080000:0.0:1783562395.072654:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562395.072784:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139072 00000100:00100000:3.0:1783562395.072788:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139072 00000100:00100000:3.0:1783562395.072826:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:3.0:1783562395.072840:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553138944:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562395.072881:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2363:x1870200553138944:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562395.072888:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:3.0:1783562395.072902:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:3.0:1783562395.072908:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553139072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562395.072934:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553139072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562395.072940:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00080000:0.0:1783562395.073063:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1783562395.446735:0:12109:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:59:53 (1783562393) 00010000:00010000:3.0:1783562395.574694:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562396.289187:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562396.291550:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139456 00000100:00100000:2.0:1783562396.291573:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139456 00000100:00100000:2.0:1783562396.294383:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 137 00000100:00100000:2.0:1783562396.294422:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+14:11268:x1870200553139456:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562396.294447:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562396.294470:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8874d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213a4 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294617:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294637:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294665:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294686:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294694:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.294702:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295249:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88762 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295277:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88762 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295285:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88762 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562396.295296:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783562396.295491:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295501:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295514:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295520:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562396.295524:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295532:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295548:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc9774c00) 00010000:00010000:2.0:1783562396.295552:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562396.295556:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295563:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88754 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295578:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295584:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295591:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295596:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562396.295599:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295616:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295624:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562396.295626:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562396.295629:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.295636:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b8875b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.296095:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8874d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213a4 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.296112:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88762 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213a4 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562396.296120:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:2.0:1783562396.296123:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562396.296126:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d600, rc 0) 00000100:00100000:2.0:1783562396.296238:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11268:x1870200553139456:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1839us (7058us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783562396.296249:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 137 00000100:00100000:2.0:1783562396.301231:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562396.301289:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562396.301356:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139712 00000100:00100000:3.0:1783562396.301368:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139712 00000100:00100000:3.0:1783562396.301490:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 138 00000100:00100000:3.0:1783562396.301502:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11268:x1870200553139712:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783562396.301791:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11268:x1870200553139712:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 Request processed in 287us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562396.301800:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 138 00000100:00100000:1.0:1783562396.301922:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139584 00000100:00100000:1.0:1783562396.301927:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139584 00000100:00100000:1.0:1783562396.301986:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562396.301993:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:2362:x1870200553139584:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562396.302006:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562396.302034:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88762 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213a4 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562396.302055:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:1.0:1783562396.302061:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562396.302084:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:2362:x1870200553139584:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 91us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562396.302090:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00010000:00010000:2.0:1783562396.600107:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562397.046779:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562397.046793:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562397.050893:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783562397.050923:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783562397.623507:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562397.645829:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.645954:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553139840 00000100:00100000:2.0:1783562397.645968:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553139840 00000100:00100000:2.0:1783562397.646192:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 139 00000100:00100000:2.0:1783562397.646206:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:11310:x1870200553139840:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562397.646239:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562397.646267:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213ab expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646358:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646377:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646391:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783562397.646560:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783562397.646664:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646674:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646683:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646984:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.646994:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647001:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647018:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562397.647023:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647032:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647048:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:2.0:1783562397.647052:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562397.647058:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647065:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647078:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647085:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647092:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647097:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562397.647100:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647107:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647127:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562397.647130:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562397.647133:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647139:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b8877e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647323:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ab expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647335:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:2.0:1783562397.647337:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562397.647341:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b88770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ab expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.647352:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:2.0:1783562397.647835:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:11310:x1870200553139840:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1630us (2019us total) trans 0 rc 301/301 00000100:00100000:2.0:1783562397.647846:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 139 00000100:00100000:2.0:1783562397.652093:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562397.652153:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140096 00000100:00100000:3.0:1783562397.652167:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140096 00000100:00100000:3.0:1783562397.652252:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 140 00000100:00100000:3.0:1783562397.652263:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:11310:x1870200553140096:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:3.0:1783562397.652337:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562397.652371:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b880e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211dd expref: 15 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.652394:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:3.0:1783562397.652430:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562397.652777:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.652790:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 5 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.652796:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.652827:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 5 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.652837:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 5 pid: 5755 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.652849:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563624320:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562397.652934:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562397.654958:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.655151:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140224 00000100:00100000:1.0:1783562397.655162:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140224 00010000:00010000:1.0:1783562397.655236:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 6 pid: 5755 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.655254:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563624320:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562397.655283:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00010000:00010000:2.0:1783562397.655287:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.655296:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2363:x1870200553140224:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562397.655315:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562397.655325:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 6 pid: 5755 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655338:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 6 pid: 5755 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655375:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2139d expref: 6 pid: 5755 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655398:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:1.0:1783562397.655426:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655437:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655449:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.655471:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562397.655520:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2363:x1870200553140224:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 228us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.655528:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00080000:1.0:1783562397.655554:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783562397.655901:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.655912:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.656051:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.656061:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.656070:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562397.657193:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783562397.657210:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657225:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657231:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657237:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562397.657241:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657249:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657264:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfce234e100) 00010000:00010000:2.0:1783562397.657267:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562397.657272:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.657278:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88785 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562397.657300:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6633dbf reply state 0000000029dd4a2e transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.657309:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562397.657399:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11310:x1870200553140096:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 5135us (5316us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1783562397.657446:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 140 00010000:00010000:1.0:1783562397.660283:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660303:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660311:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660326:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562397.660330:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660346:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660362:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bfcc4c37a00) 00010000:00010000:1.0:1783562397.660364:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562397.660368:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.660373:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8878c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.701057:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.701192:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140352 00000100:00100000:2.0:1783562397.701204:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140352 00000100:00100000:2.0:1783562397.701283:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 141 00000100:00100000:2.0:1783562397.701294:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+15:11318:x1870200553140352:12345-192.168.204.4@tcp:101:lctl.0 00010000:00010000:2.0:1783562397.701323:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562397.701350:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213b2 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701463:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701479:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701493:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562397.701562:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562397.701566:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562397.701594:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701632:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b2 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701649:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b2 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.701658:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562397.701661:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562397.701666:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d800, rc 0) 00000100:00100000:2.0:1783562397.701739:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11318:x1870200553140352:12345-192.168.204.4@tcp:101:lctl.0 Request processed in 446us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562397.701754:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 141 00000100:00100000:2.0:1783562397.749657:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.749732:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140480 00000100:00100000:1.0:1783562397.749746:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140480 00000100:00100000:1.0:1783562397.749822:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 142 00000100:00100000:1.0:1783562397.749834:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+16:11324:x1870200553140480:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562397.749862:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562397.749890:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b887a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213b9 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.749987:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750006:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750021:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750042:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750079:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750087:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750223:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750233:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750241:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562397.750279:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783562397.750283:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562397.750309:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750323:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750331:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750344:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750353:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562397.750360:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750376:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750393:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562397.750448:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562397.750455:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750462:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b887a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.750999:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751007:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751014:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751020:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562397.751023:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751030:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751041:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562397.751043:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562397.751047:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751123:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499200/0x4738ba0933b887af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751171:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b887a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b9 expref: 18 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751185:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b9 expref: 17 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.751194:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562397.751196:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783562397.751199:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499600, rc 0) 00000100:00100000:1.0:1783562397.751344:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:11324:x1870200553140480:12345-192.168.204.4@tcp:101:bash.0 Request processed in 1511us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.751354:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 142 00000100:00100000:1.0:1783562397.754989:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.755156:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140736 00000100:00100000:2.0:1783562397.755169:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140736 00000100:00100000:2.0:1783562397.755234:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 143 00000100:00100000:2.0:1783562397.755247:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:11324:x1870200553140736:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562397.755270:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562397.755295:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b887bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213c0 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756071:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756092:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756105:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756174:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756183:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.756190:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562397.756875:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783562397.757081:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757099:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757109:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757145:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757153:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757161:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757167:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562397.757172:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757180:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757194:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562397.757197:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562397.757202:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757209:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b887c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562397.757220:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f70eea93 reply state 000000008632be99 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.757235:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783562397.757275:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b887bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757292:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 19 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.757300:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562397.757302:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562397.757305:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c600, rc 0) 00000100:00100000:2.0:1783562397.757395:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11324:x1870200553140736:12345-192.168.204.4@tcp:101:bash.0 Request processed in 2150us (2416us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783562397.757429:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 143 00010000:00010000:1.0:1783562397.761807:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762084:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762090:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762095:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562397.762099:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762119:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762133:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562397.762135:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562397.762139:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.762144:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b887cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.762220:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562397.762347:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140864 00000100:00100000:3.0:1783562397.762361:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140864 00000100:00080000:1.0:1783562397.762426:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562397.762528:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1783562397.762538:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553140864:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562397.762555:0:6550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562397.762572:0:6550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213c7 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562397.762597:0:6550:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562397.762629:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=207s v=(0 0) 00010000:00010000:3.0:1783562397.762640:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562397.762650:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 6 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.762672:0:6550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 6 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.762686:0:6550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337400, rc 0) 00000100:00100000:3.0:1783562397.762759:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553140864:12345-192.168.204.4@tcp:101:bash.0 Request processed in 222us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562397.762766:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1783562397.765589:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.765646:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553140992 00000100:00100000:1.0:1783562397.765658:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553140992 00000100:00100000:1.0:1783562397.765733:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:1.0:1783562397.765745:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:11324:x1870200553140992:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562397.765766:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562397.765787:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213ce expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.765822:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.765831:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562397.765835:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562397.765841:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 7 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.765919:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.765941:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.765960:0:6549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6549:1870200563624448:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562397.766072:0:6549:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562397.769662:0:6549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6549:1870200563624448:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562397.769720:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 7 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.769750:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499200, rc 0) 00000100:00100000:0.0:1783562397.770230:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:11324:x1870200553140992:12345-192.168.204.4@tcp:101:bash.0 Request processed in 4484us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562397.770242:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:2.0:1783562397.770853:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.771264:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553141120 00000100:00100000:1.0:1783562397.771278:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553141120 00010000:00010000:1.0:1783562397.771327:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.771383:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:1.0:1783562397.771393:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553141120:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562397.771450:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562397.771480:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.771495:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.771521:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b887e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c7 expref: 7 pid: 6550 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.771564:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562397.771569:0:5740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562397.771590:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.771600:0:5740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.771658:0:5740:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.771678:0:5740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6684000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5740:1870200563624576:192.168.204.4@tcp:105: 00000100:00100000:1.0:1783562397.771773:0:5740:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562397.774697:0:5740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6684000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5740:1870200563624576:192.168.204.4@tcp:105: 00010000:00010000:1.0:1783562397.774741:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562397.775209:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2363:x1870200553141120:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 3813us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.775226:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:0.0:1783562397.778129:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.778260:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553141376 00000100:00100000:2.0:1783562397.778276:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553141376 00000100:00100000:2.0:1783562397.778527:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:2.0:1783562397.778541:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:11324:x1870200553141376:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:2.0:1783562397.779117:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11324:x1870200553141376:12345-192.168.204.4@tcp:35:bash.0 Request processed in 569us (989us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1783562397.779128:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:2.0:1783562397.834152:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562397.834303:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553141632 00000100:00100000:0.0:1783562397.834315:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553141632 00000100:00100000:0.0:1783562397.834493:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 144 00000100:00100000:0.0:1783562397.834507:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11334:x1870200553141632:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562397.834554:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562397.834579:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b887ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213d5 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562397.834742:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783562397.834872:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b887ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213d5 expref: 22 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.834888:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562397.834892:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562397.834897:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b887ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213d5 expref: 22 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.834911:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8a00, rc 0) 00000100:00100000:0.0:1783562397.834988:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:11334:x1870200553141632:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 485us (849us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1783562397.834996:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 144 00000100:00100000:2.0:1783562397.842058:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562397.842213:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553141888 00000100:00100000:0.0:1783562397.842226:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553141888 00000100:00100000:0.0:1783562397.842342:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:0.0:1783562397.842359:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:11334:x1870200553141888:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562397.842826:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:11334:x1870200553141888:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 473us (779us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783562397.842836:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:2.0:1783562397.900599:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562397.900745:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142016 00000100:00100000:0.0:1783562397.900761:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142016 00000100:00100000:0.0:1783562397.900929:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 145 00000100:00100000:0.0:1783562397.900957:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:11340:x1870200553142016:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562397.900989:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562397.901014:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b887fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213dc expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901107:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901127:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901143:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562397.901227:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783562397.901232:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562397.901264:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901303:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b887fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213dc expref: 24 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901328:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213dc expref: 23 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.901337:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562397.901340:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562397.901345:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9400, rc 0) 00000100:00100000:0.0:1783562397.901638:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11340:x1870200553142016:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 682us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562397.901659:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 145 00000100:00100000:2.0:1783562397.906072:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.906609:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142272 00000100:00100000:1.0:1783562397.906628:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142272 00000100:00100000:1.0:1783562397.906727:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 146 00000100:00100000:1.0:1783562397.906738:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11340:x1870200553142272:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562397.906768:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562397.906796:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8880a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213e3 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.906935:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.906950:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.906965:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562397.906980:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783562397.907135:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499e00/0x4738ba0933b8880a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213e3 expref: 26 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.907156:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213e3 expref: 25 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.907166:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:1.0:1783562397.907169:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562397.907175:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499a00, rc 0) 00000100:00100000:1.0:1783562397.907252:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11340:x1870200553142272:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 516us (1196us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1783562397.907261:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 146 00000100:00100000:2.0:1783562397.909957:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562397.910088:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142400 00000100:00100000:3.0:1783562397.910099:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142400 00000100:00100000:3.0:1783562397.910449:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562397.910462:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:2364:x1870200553142400:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562397.910478:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562397.910505:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499a00/0x4738ba0933b88811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213e3 expref: 25 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.910526:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:3.0:1783562397.910532:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562397.910583:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562397.910604:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2364:x1870200553142400:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 143us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562397.910612:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562397.910695:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142656 00000100:00100000:1.0:1783562397.910700:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142656 00000100:00100000:1.0:1783562397.910733:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 147 00000100:00100000:1.0:1783562397.910740:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11340:x1870200553142656:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562397.910771:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562397.910786:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b8881f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213ea expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.910884:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.910898:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.910910:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562397.910920:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783562397.911049:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b8881f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ea expref: 27 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.911064:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ea expref: 26 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.911071:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:1.0:1783562397.911074:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783562397.911077:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683800, rc 0) 00000100:00100000:1.0:1783562397.911120:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11340:x1870200553142656:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 380us (538us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783562397.911126:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 147 00000100:00100000:1.0:1783562397.918528:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.918577:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142784 00000100:00100000:2.0:1783562397.918588:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142784 00000100:00100000:2.0:1783562397.918670:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:2.0:1783562397.918684:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2362:x1870200553142784:12345-192.168.204.4@tcp:1:lfs.0 00010000:00010000:2.0:1783562397.918738:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.918763:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.918772:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562397.918777:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562397.918782:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.918823:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.918839:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 6 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.918855:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563624704:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562397.918959:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6ec1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562397.921371:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563624704:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562397.921449:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.922730:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562397.922886:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553142912 00000100:00100000:3.0:1783562397.922911:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553142912 00002000:00100000:3.0:1783562397.923011:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bfcf6685880 x1870200553142912/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:238/0 lens 504/0 e 0 to 0 dl 1783562408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783562397.923023:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6685880 with x1870200553142912 ext(0->12) 00010000:00010000:3.0:1783562397.923035:0:6554:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 7 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.923053:0:6554:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 7 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562397.923062:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcf6685880 00000100:00100000:3.0:1783562397.923143:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:3.0:1783562397.923153:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553142912:12345-192.168.204.4@tcp:4:lfs.0 00000100:00100000:3.0:1783562397.923855:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553142912:12345-192.168.204.4@tcp:4:lfs.0 Request processed in 701us (1129us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783562397.923863:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00002000:00100000:3.0:1783562397.923871:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bfcf6685880 x1870200553142912/t4294967305(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:238/0 lens 504/448 e 0 to 0 dl 1783562408 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783562397.923879:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6685880 with x1870200553142912 ext(0->12) 00010000:00010000:3.0:1783562397.923885:0:6554:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562397.923898:0:6554:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562397.923905:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcf6685880 00000100:00100000:3.0:1783562397.926705:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.926908:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553143040 00000100:00100000:1.0:1783562397.926936:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553143040 00010000:00010000:1.0:1783562397.926976:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.927086:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:1.0:1783562397.927098:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553143040:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562397.927111:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783562397.927134:0:5739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783562397.927138:0:5739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783562396 00002000:00010000:1.0:1783562397.927140:0:5739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783562396 00002000:00010000:1.0:1783562397.927143:0:5739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783562396 00010000:00010000:1.0:1783562397.927149:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.927163:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.927186:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f193ffdd/0x4738ba0933b887e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ce expref: 9 pid: 6549 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.927205:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562397.927209:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562397.927215:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.927225:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.927275:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562397.927339:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553143040:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 242us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.927347:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00010000:00010000:2.0:1783562397.927428:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927439:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927466:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927486:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927495:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927511:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562397.927516:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927526:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927539:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.927560:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1cbe25/0x4738ba0933b88834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.927631:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2362:x1870200553142784:12345-192.168.204.4@tcp:1:lfs.0 Request processed in 8950us (9114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562397.927640:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:1.0:1783562397.931172:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562397.931223:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553143296 00000100:00100000:2.0:1783562397.931234:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553143296 00000100:00100000:2.0:1783562397.931302:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562397.931311:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5197850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11340:x1870200553143296:12345-192.168.204.4@tcp:35:lfs.0 00000004:00010000:2.0:1783562397.931378:0:5758:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ea expref: 26 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562397.932008:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1783562397.932072:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1783562397.932930:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1783562397.933010:0:5758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.933028:0:5758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.933038:0:5758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.933079:0:5758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.933108:0:5758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 30 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.933123:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563624832:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562397.933232:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562397.935791:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562397.935900:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553143424 00000100:00100000:1.0:1783562397.935918:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553143424 00010000:00010000:1.0:1783562397.935983:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 31 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562397.936043:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:1.0:1783562397.936056:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2363:x1870200553143424:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562397.936077:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562397.936086:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 31 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.936104:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 31 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.936136:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:1.0:1783562397.936142:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.936156:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.936183:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562397.936231:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562397.936328:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2363:x1870200553143424:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 273us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.936338:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00010000:00010000:0.0:1783562397.937009:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b887d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213c0 expref: 30 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562397.937074:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5758:1870200563624832:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562397.937103:0:5758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.937110:0:5758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.937114:0:5758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562397.937315:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783562397.937658:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1783562397.937798:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563624960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783562397.937891:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562397.937934:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562397.938044:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563624960 00000100:00100000:1.0:1783562397.938053:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563624960 00000100:00100000:1.0:1783562397.938146:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562397.938160:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563624960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783562397.938269:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563624960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562397.938277:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783562397.938310:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562397.938330:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563624960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783562397.939016:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1783562397.939389:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563625088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783562397.939516:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562397.939554:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52cd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562397.939659:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625088 00000100:00100000:1.0:1783562397.939669:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625088 00000100:00100000:1.0:1783562397.939723:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783562397.939733:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1870200563625088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783562397.939954:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1870200563625088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (436us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783562397.939962:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562397.940069:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5758:1870200563625088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783562397.940137:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1783562397.940199:0:5758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940209:0:5758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940217:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940223:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562397.940229:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940239:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940277:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562397.940280:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783562397.940287:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562397.940294:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b8883b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562397.940543:0:5758:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783562397.940687:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1783562397.940701:0:5758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 207197297232ns, next at 208197295206ns, rc = 0 00000001:00080000:2.0:1783562397.940707:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1783562397.940740:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562397.940744:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783562397.940751:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88826 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ea expref: 34 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562397.941717:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5197850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:11340:x1870200553143296:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 10398us (10548us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1783562397.941731:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000020:00080000:2.0:1783562397.941737:0:5758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783562397.946175:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562397.946349:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553143552 00000100:00100000:0.0:1783562397.946365:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553143552 00000100:00100000:0.0:1783562397.946476:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 148 00000100:00100000:0.0:1783562397.946487:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:11340:x1870200553143552:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562397.946521:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562397.946550:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213f1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.946677:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213f1 expref: 34 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.946693:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213f1 expref: 34 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562397.946712:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562397.946714:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562397.946718:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8a00, rc 0) 00000100:00100000:0.0:1783562397.946794:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11340:x1870200553143552:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 308us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562397.946802:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 148 00000100:00100000:3.0:1783562397.955697:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562397.956186:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553143808 00000100:00100000:0.0:1783562397.956202:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553143808 00000100:00100000:0.0:1783562397.956550:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:0.0:1783562397.956564:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11340:x1870200553143808:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562397.956928:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11340:x1870200553143808:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 367us (1249us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1783562397.956938:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:2.0:1783562398.012043:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.012116:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553144064 00000100:00100000:0.0:1783562398.012128:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553144064 00000100:00100000:0.0:1783562398.012211:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 149 00000100:00100000:0.0:1783562398.012223:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11350:x1870200553144064:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562398.012263:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.012304:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213f8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.012622:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783562398.012833:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88849 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213f8 expref: 37 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.012855:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562398.012859:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562398.012866:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213f8 expref: 37 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.012896:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:1.0:1783562398.012988:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11350:x1870200553144064:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 765us (966us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1783562398.012998:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 149 00000100:00100000:3.0:1783562398.017286:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.018170:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553144192 00000100:00100000:0.0:1783562398.018184:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553144192 00000100:00100000:0.0:1783562398.018263:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 150 00000100:00100000:0.0:1783562398.018277:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11350:x1870200553144192:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:0.0:1783562398.018811:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.018837:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.018853:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.018871:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.018879:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.018885:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.020230:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.020255:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.020269:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562398.021743:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021771:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021780:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021787:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021794:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.021798:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021805:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021821:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562398.021824:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562398.021829:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021834:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021850:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021856:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021876:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021881:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.021884:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021890:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021898:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562398.021900:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562398.021903:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021909:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b8885e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021927:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021934:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021939:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021944:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.021947:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021963:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021971:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.021974:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562398.021977:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.021984:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.022105:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11350:x1870200553144192:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 3825us (4836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.022115:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 150 00000100:00100000:3.0:1783562398.025051:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562398.025227:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553144448 00000100:00100000:2.0:1783562398.025243:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553144448 00000100:00100000:2.0:1783562398.025329:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:2.0:1783562398.025344:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11350:x1870200553144448:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562398.025942:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11350:x1870200553144448:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 597us (906us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1783562398.025973:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:2.0:1783562398.070833:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.070944:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553144704 00000100:00100000:0.0:1783562398.070960:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553144704 00000100:00100000:0.0:1783562398.071095:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 151 00000100:00100000:0.0:1783562398.071109:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11353:x1870200553144704:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562398.071152:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.071189:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8886c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c213ff expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071310:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071333:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071350:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071399:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071427:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071434:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071674:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071685:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071693:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562398.071705:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783562398.071858:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071866:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071875:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071882:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.071888:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071908:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071926:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562398.071930:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562398.071937:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071943:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071960:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071967:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071973:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071980:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.071982:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071989:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.071996:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562398.071999:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562398.072002:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.072018:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8887a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.072082:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8886c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 40 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.072097:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 39 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.072104:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.072107:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562398.072110:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:1.0:1783562398.072729:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563625472:0@lo:400:kworker.0 00000100:00100000:1.0:1783562398.072908:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562398.072976:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563625216:0@lo:400:kworker.0 00000100:00100000:3.0:1783562398.073082:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562398.073142:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563625728:0@lo:400:kworker.0 00000100:00100000:3.0:1783562398.073176:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562398.073207:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562398.073215:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563625344:0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073215:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625472 00000100:00100000:2.0:1783562398.073228:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625472 00000100:00100000:1.0:1783562398.073228:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562398.073236:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563625600:0@lo:400:kworker.0 00000100:00100000:3.0:1783562398.073243:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562398.073253:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625216 00000100:00100000:2.0:1783562398.073258:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625216 00000100:00100000:1.0:1783562398.073262:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562398.073276:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625728 00000100:00100000:3.0:1783562398.073281:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625728 00000100:00100000:2.0:1783562398.073324:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783562398.073336:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073432:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563625216:12345-0@lo:400:kworker.0 Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562398.073439:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783562398.073485:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783562398.073494:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563625728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073509:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625344 00000100:00100000:2.0:1783562398.073514:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625344 00000100:00100000:2.0:1783562398.073532:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625600 00000100:00100000:2.0:1783562398.073534:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625600 00000100:00100000:3.0:1783562398.073541:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563625728:12345-0@lo:400:kworker.0 Request processed in 48us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562398.073549:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783562398.073553:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783562398.073564:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563625472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562398.073597:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563625216:0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073607:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563625472:12345-0@lo:400:kworker.0 Request processed in 45us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562398.073627:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563625728:0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073628:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783562398.073634:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563625472:0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.073653:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783562398.073662:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563625344:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783562398.073664:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783562398.073673:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562398.073701:0:6572:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783562398.073712:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1783562398.073886:0:5754:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783562398.073895:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783562398.073901:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563625600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562398.074435:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563625344:12345-0@lo:400:kworker.0 Request processed in 773us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562398.074442:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783562398.074512:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563625344:0@lo:400:kworker.0 00000100:00100000:1.0:1783562398.074751:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563625600:12345-0@lo:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.075082:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783562398.075164:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563625600:0@lo:400:kworker.0 00000100:00100000:0.0:1783562398.076457:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11353:x1870200553144704:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 5341us (5631us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1783562398.076468:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 151 00000100:00100000:1.0:1783562398.082632:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.082686:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553144832 00000100:00100000:1.0:1783562398.082697:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553144832 00000100:00100000:1.0:1783562398.082774:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 152 00000100:00100000:1.0:1783562398.082796:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11353:x1870200553144832:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562398.082906:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.082943:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083045:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083087:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083095:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083102:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083108:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.083112:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083119:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083134:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.083138:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562398.083149:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.083157:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8888f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.083246:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11353:x1870200553144832:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 461us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.083262:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 152 00000100:00100000:3.0:1783562398.087743:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.088097:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553145088 00000100:00100000:0.0:1783562398.088110:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553145088 00000100:00100000:0.0:1783562398.088222:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:0.0:1783562398.088236:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11353:x1870200553145088:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562398.090315:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:11353:x1870200553145088:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 2069us (2576us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783562398.090331:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 41 00000001:00080000:3.0:1783562398.120764:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000020:00080000:3.0:1783562398.120838:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:3.0:1783562398.120863:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783562398.120881:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc2a3bb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1783562398.120887:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcc5c89f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc2a3b9c0 00000020:00080000:3.0:1783562398.120890:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcc5c89e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef189000 00000020:00080000:0.0:1783562398.121071:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1783562398.121387:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1783562398.121632:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562398.121661:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563625856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783562398.121851:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562398.122089:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563625856 00000100:00100000:0.0:1783562398.122097:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563625856 00000100:00100000:0.0:1783562398.122232:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783562398.122244:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563625856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783562398.122600:0:6550:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1783562398.122655:0:6550:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4f009c, atime: 0x6a4f009c, ctime: 0x6a4f009c, blocks: 0x1 00010000:00010000:0.0:1783562398.122665:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.122760:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=207s v=(0 0) 00010000:00010000:0.0:1783562398.122766:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562398.122775:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.122792:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.122804:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.122813:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.122840:0:6550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562398.123070:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562398.123078:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.123086:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562398.123091:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.123101:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.123120:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.123206:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e515fb/0x4738ba0933b88896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.123234:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562398.123236:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562398.123251:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562398.124342:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3274:x1870200563625856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2091us (2482us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783562398.124357:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1783562398.124578:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf7122680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1783562398.124587:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563625856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783562398.303656:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.306490:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553145344 00000100:00100000:0.0:1783562398.306512:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553145344 00000100:00100000:0.0:1783562398.306641:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 153 00000100:00100000:0.0:1783562398.306653:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:11384:x1870200553145344:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562398.306680:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.306704:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8889d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21406 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.306900:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.306926:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.306945:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562398.306966:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783562398.307143:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b8889d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21406 expref: 21 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.307164:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21406 expref: 20 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.307174:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.307177:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562398.307181:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562398.307298:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11384:x1870200553145344:12345-192.168.204.4@tcp:101:cat.0 Request processed in 644us (3659us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783562398.307352:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 153 00000100:00100000:3.0:1783562398.312648:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562398.312767:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553145600 00000100:00100000:2.0:1783562398.312788:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553145600 00000100:00100000:2.0:1783562398.312887:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:2.0:1783562398.312903:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11384:x1870200553145600:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:3.0:1783562398.313257:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562398.313293:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:11384:x1870200553145600:12345-192.168.204.4@tcp:35:cat.0 Request processed in 392us (726us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783562398.313303:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:0.0:1783562398.315980:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553145728 00000100:00100000:0.0:1783562398.316021:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553145728 00000100:00100000:0.0:1783562398.316141:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562398.316151:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2363:x1870200553145728:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562398.316179:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562398.316219:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21406 expref: 21 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.316251:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.316258:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562398.316359:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:2363:x1870200553145728:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 209us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.316366:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:3.0:1783562398.368925:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.369029:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553145984 00000100:00100000:0.0:1783562398.369045:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553145984 00000100:00100000:0.0:1783562398.369190:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 154 00000100:00100000:0.0:1783562398.369204:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11390:x1870200553145984:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1783562398.369249:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.369253:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783562398.369292:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213dc expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369323:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562398.369330:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562398.369348:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2140d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369591:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369626:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369636:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369717:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.369733:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 20 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.369762:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563625984:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562398.369928:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690900 going to sleep for 11 seconds 00000100:00100000:3.0:1783562398.371940:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.372113:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553146112 00000100:00100000:1.0:1783562398.372134:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553146112 00010000:00010000:1.0:1783562398.372197:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 21 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.372253:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:1.0:1783562398.372265:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2364:x1870200553146112:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562398.372286:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562398.372295:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 21 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.372313:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 21 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.372333:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563625984:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562398.372360:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213ff expref: 21 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.372388:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.372389:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.372399:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.372451:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.372462:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.372525:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562398.372584:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.372615:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:2364:x1870200553146112:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 342us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.372625:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00010000:00010000:0.0:1783562398.372666:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562398.372746:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783562398.373099:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 21 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.373121:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.373129:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.373133:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562398.373135:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562398.373189:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11390:x1870200553145984:12345-192.168.204.4@tcp:101:dd.0 Request processed in 3988us (4290us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783562398.373197:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 154 00000100:00100000:3.0:1783562398.375681:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.375934:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553146368 00000100:00100000:1.0:1783562398.375953:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553146368 00000100:00100000:1.0:1783562398.376052:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 155 00000100:00100000:1.0:1783562398.376067:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11390:x1870200553146368:12345-192.168.204.4@tcp:36:dd.0 00010000:00010000:1.0:1783562398.376577:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.376602:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.376635:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562398.376713:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1783562398.376740:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a36b0d2 reply state 00000000de47f4b1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.376751:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562398.377132:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11390:x1870200553146368:12345-192.168.204.4@tcp:36:dd.0 Request processed in 1065us (1471us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1783562398.377142:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 155 00000020:00080000:1.0:1783562398.377150:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562398.380104:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380163:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380173:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380182:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.380188:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380198:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380227:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.380230:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.380238:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.380244:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b888c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562398.552646:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.553686:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553146496 00000100:00100000:0.0:1783562398.553705:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553146496 00000100:00100000:0.0:1783562398.553805:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 156 00000100:00100000:0.0:1783562398.553821:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:11404:x1870200553146496:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:0.0:1783562398.553865:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.553901:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21414 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554027:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554047:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554062:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554109:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554118:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.554125:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.555360:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.555612:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.555625:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.555686:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.555707:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 23 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.555731:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563626112:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562398.555979:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562398.558845:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563626112:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562398.558896:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562398.559678:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.560136:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553146752 00000100:00100000:0.0:1783562398.560149:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553146752 00000100:00100000:0.0:1783562398.560233:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:0.0:1783562398.560246:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:5570:x1870200553146752:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783562398.561304:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:5570:x1870200553146752:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 1048us (1619us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1783562398.561317:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:3.0:1783562398.563801:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.563955:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553146880 00000100:00100000:0.0:1783562398.563970:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553146880 00010000:00010000:0.0:1783562398.564029:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 25 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.564103:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:0.0:1783562398.564112:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:2363:x1870200553146880:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562398.564129:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562398.564135:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 25 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564148:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 25 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564176:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2140d expref: 25 pid: 5756 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564197:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.564224:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564239:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564249:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.564298:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562398.564379:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:2363:x1870200553146880:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 266us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.564388:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00010000:00010000:1.0:1783562398.564541:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564552:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.564631:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783562398.564637:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562398.564668:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564698:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564710:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564717:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564723:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564729:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.564734:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564856:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564867:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562398.564871:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.564876:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564883:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b888d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564895:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564902:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564914:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564920:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.564923:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564930:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564938:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562398.564940:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.564943:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564949:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b888dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.564997:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b888ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21414 expref: 24 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.565013:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21414 expref: 23 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.565019:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.565020:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562398.565023:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:1.0:1783562398.565060:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11404:x1870200553146496:12345-192.168.204.4@tcp:101:stat.0 Request processed in 11245us (12433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.565076:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 156 00000100:00100000:0.0:1783562398.584309:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562398.584464:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562398.584640:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563626240 00000100:00100000:1.0:1783562398.584653:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563626240 00000100:00100000:1.0:1783562398.584728:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783562398.584740:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563626240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783562398.584792:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562398.584860:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563626240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.584867:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783562398.584941:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562398.585741:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563626368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562398.585798:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562398.585914:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563626368 00000100:00100000:0.0:1783562398.585924:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563626368 00000100:00100000:0.0:1783562398.585969:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783562398.585979:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563626368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562398.585999:0:6551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562398.586047:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563626368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.586057:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783562398.586262:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563626368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562398.606114:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.606851:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553147136 00000100:00100000:0.0:1783562398.606872:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553147136 00000100:00100000:0.0:1783562398.606972:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 157 00000100:00100000:0.0:1783562398.606987:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11410:x1870200553147136:12345-192.168.204.4@tcp:36:truncate.0 00010000:00010000:0.0:1783562398.607086:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562398.607313:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b888e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21414 expref: 23 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.607345:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.607354:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562398.607878:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.607898:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.607913:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562398.607978:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1783562398.608006:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000461f71fd reply state 00000000943b230b transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.608017:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562398.608178:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11410:x1870200553147136:12345-192.168.204.4@tcp:36:truncate.0 Request processed in 1193us (2080us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783562398.608187:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 157 00000020:00080000:0.0:1783562398.608195:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562398.610167:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610190:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610202:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610209:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.610216:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610225:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610281:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.610285:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.610291:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.610299:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b888ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562398.647356:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562398.713587:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.714038:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553147264 00000100:00100000:1.0:1783562398.714055:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553147264 00000100:00100000:1.0:1783562398.714151:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 158 00000100:00100000:1.0:1783562398.714165:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11424:x1870200553147264:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:1.0:1783562398.714202:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562398.714233:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b888f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2141b expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714328:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714347:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714377:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714397:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714438:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714483:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.714998:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715008:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715017:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.715070:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783562398.715075:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562398.715103:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715116:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715126:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715133:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715141:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715148:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.715154:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715170:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715186:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562398.715189:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.715195:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715201:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b888f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715218:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715225:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715231:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715237:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.715239:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715245:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715253:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562398.715255:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.715259:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715276:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b888ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715328:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b888f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 26 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715345:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 25 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.715353:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.715355:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562398.715358:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683000, rc 0) 00000100:00100000:1.0:1783562398.715522:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11424:x1870200553147264:12345-192.168.204.4@tcp:101:stat.0 Request processed in 1359us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.715533:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 158 00000100:00100000:3.0:1783562398.781237:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.781379:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553147520 00000100:00100000:1.0:1783562398.781395:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553147520 00000100:00100000:1.0:1783562398.781610:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 159 00000100:00100000:1.0:1783562398.781625:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11434:x1870200553147520:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562398.781656:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562398.781685:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b8890d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21422 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.782081:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1783562398.782283:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b8890d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21422 expref: 27 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.782319:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562398.782323:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562398.782329:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b8890d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21422 expref: 27 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.782355:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682000, rc 0) 00000100:00100000:1.0:1783562398.782513:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11434:x1870200553147520:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 893us (1291us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1783562398.782521:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 159 00000100:00100000:3.0:1783562398.786153:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.786224:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553147776 00000100:00100000:1.0:1783562398.786241:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553147776 00000100:00100000:1.0:1783562398.786449:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:1.0:1783562398.786464:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5195450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11434:x1870200553147776:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562398.787297:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5195450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:11434:x1870200553147776:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 830us (1154us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783562398.787309:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:3.0:1783562398.829955:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.831086:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148032 00000100:00100000:0.0:1783562398.831107:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148032 00000100:00100000:0.0:1783562398.831224:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 160 00000100:00100000:0.0:1783562398.831240:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:11440:x1870200553148032:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562398.831287:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.831320:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8891b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21429 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.831535:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.831553:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 28 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.831580:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.831645:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 28 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.831663:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 28 pid: 5754 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.831682:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563626496:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562398.831845:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562398.837329:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563626496:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562398.837731:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562398.838707:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.838792:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148160 00000100:00100000:1.0:1783562398.838805:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148160 00010000:00010000:1.0:1783562398.838866:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 29 pid: 5754 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.838915:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:1.0:1783562398.838925:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:2363:x1870200553148160:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562398.838946:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562398.838954:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 29 pid: 5754 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.838993:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 29 pid: 5754 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.839026:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2141b expref: 29 pid: 5754 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.839046:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.839050:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.839060:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.839067:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.839362:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562398.839531:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:2363:x1870200553148160:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 603us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.839541:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00010000:00010000:0.0:1783562398.839927:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.839944:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562398.839978:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783562398.841207:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b8891b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.841243:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 28 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.841256:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.841259:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562398.841264:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562398.841446:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11440:x1870200553148032:12345-192.168.204.4@tcp:101:bash.0 Request processed in 10208us (11507us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1783562398.841458:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 160 00000100:00100000:3.0:1783562398.848562:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.848864:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148416 00000100:00100000:1.0:1783562398.848882:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148416 00000100:00100000:1.0:1783562398.849055:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 161 00000100:00100000:1.0:1783562398.849069:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11440:x1870200553148416:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:1.0:1783562398.849571:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.849594:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.849640:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562398.849712:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1783562398.849740:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004b55f53 reply state 000000002c4f8ea5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.849752:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562398.849889:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11440:x1870200553148416:12345-192.168.204.4@tcp:36:bash.0 Request processed in 820us (1348us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1783562398.849898:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 161 00000020:00080000:1.0:1783562398.849906:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562398.852070:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852095:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852104:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852111:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.852118:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852127:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852157:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.852161:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.852194:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.852202:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88930 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562398.855725:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.855806:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148544 00000100:00100000:1.0:1783562398.855827:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148544 00000100:00100000:1.0:1783562398.855933:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 162 00000100:00100000:1.0:1783562398.855949:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:11440:x1870200553148544:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562398.856001:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562398.856034:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21430 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.856185:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.856211:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 31 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.856225:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.856289:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 31 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.856310:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 31 pid: 5756 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.856329:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563626624:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562398.856566:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562398.860629:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.860734:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6685c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563626624:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562398.860777:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.861018:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148672 00000100:00100000:0.0:1783562398.861031:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148672 00010000:00010000:0.0:1783562398.861152:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 32 pid: 5756 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562398.861217:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562398.861228:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:2363:x1870200553148672:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562398.861250:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562398.861263:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 32 pid: 5756 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861277:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 32 pid: 5756 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861306:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88922 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21429 expref: 32 pid: 5756 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861355:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562398.861361:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861373:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861383:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.861466:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562398.861470:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.861481:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.861549:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000100:00100000:0.0:1783562398.861552:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2363:x1870200553148672:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 323us (937us total) trans 0 rc 0/0 00000004:00200000:1.0:1783562398.861554:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1783562398.861564:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000004:00010000:1.0:1783562398.861609:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.861660:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21430 expref: 31 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.861691:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21430 expref: 30 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.861707:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.861710:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562398.861713:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683c00, rc 0) 00000100:00100000:1.0:1783562398.861750:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:11440:x1870200553148544:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5806us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.861759:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 162 00000100:00100000:2.0:1783562398.865565:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.865693:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553148928 00000100:00100000:0.0:1783562398.865709:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553148928 00000100:00100000:0.0:1783562398.865793:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:0.0:1783562398.865807:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+30:11440:x1870200553148928:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:0.0:1783562398.866175:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11440:x1870200553148928:12345-192.168.204.4@tcp:35:bash.0 Request processed in 370us (640us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1783562398.866185:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:3.0:1783562398.919962:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.920121:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553149184 00000100:00100000:0.0:1783562398.920137:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553149184 00000100:00100000:0.0:1783562398.920231:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 163 00000100:00100000:0.0:1783562398.920245:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11450:x1870200553149184:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562398.920288:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562398.920351:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21437 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562398.920869:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1783562398.921123:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88945 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21437 expref: 33 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.921144:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562398.921147:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562398.921153:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21437 expref: 33 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.921170:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562398.921336:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11450:x1870200553149184:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1092us (1707us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1783562398.921346:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 163 00000100:00100000:3.0:1783562398.926323:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.926657:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553149312 00000100:00100000:1.0:1783562398.926697:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553149312 00000100:00100000:1.0:1783562398.926780:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 164 00000100:00100000:1.0:1783562398.926795:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11450:x1870200553149312:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:1.0:1783562398.926914:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.926938:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.926953:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.926974:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.926982:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.926990:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927480:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927492:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927501:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562398.927565:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927594:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927611:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927619:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927625:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.927630:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927639:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927656:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562398.927659:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.927665:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927671:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927683:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927689:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927695:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927705:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.927708:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927714:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927723:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562398.927725:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.927728:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927734:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8895a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927752:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927758:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927764:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927769:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.927772:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927778:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927798:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.927800:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.927804:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.927810:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562398.927941:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11450:x1870200553149312:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 1146us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562398.927951:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 164 00000100:00100000:2.0:1783562398.931038:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.932811:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553149568 00000100:00100000:1.0:1783562398.932842:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553149568 00000100:00100000:1.0:1783562398.932990:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:1.0:1783562398.933005:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11450:x1870200553149568:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562398.933859:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:11450:x1870200553149568:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 852us (2834us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1783562398.933872:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:3.0:1783562398.968362:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562398.968456:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553149824 00000100:00100000:1.0:1783562398.968472:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553149824 00000100:00100000:1.0:1783562398.968564:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 165 00000100:00100000:1.0:1783562398.968588:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+33:11453:x1870200553149824:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562398.968638:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562398.968672:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2143e expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968793:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968829:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968844:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968864:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968871:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.968878:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969379:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b8897d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969390:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b8897d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969398:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b8897d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562398.969457:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783562398.969611:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969620:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969626:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969643:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.969650:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969661:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969687:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562398.969691:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.969699:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969705:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b8896f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969722:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969727:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969734:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969739:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562398.969742:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969749:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969768:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562398.969771:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562398.969775:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969781:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969846:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2143e expref: 36 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969864:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b8897d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2143e expref: 35 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.969872:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.969875:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562398.969878:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682600, rc 0) 00000100:00100000:1.0:1783562398.970013:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11453:x1870200553149824:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1428us (1666us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1783562398.970022:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 165 00000100:00100000:3.0:1783562398.976892:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562398.976970:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562398.977114:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553149952 00000100:00100000:0.0:1783562398.977134:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553149952 00000100:00100000:1.0:1783562398.977234:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553150080 00000100:00100000:1.0:1783562398.977240:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553150080 00000100:00100000:1.0:1783562398.977310:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 166 00000100:00100000:0.0:1783562398.977321:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1783562398.977327:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11453:x1870200553150080:12345-192.168.204.4@tcp:54:lfs.0 00000100:00100000:0.0:1783562398.977339:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:2363:x1870200553149952:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562398.977363:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562398.977475:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.977504:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.977545:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978167:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978180:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978187:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978203:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562398.978209:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b8897d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2143e expref: 36 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978211:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978230:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562398.978247:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.978250:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562398.978256:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.978258:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562398.978267:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b8898b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562398.978268:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562398.978395:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11453:x1870200553150080:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 1072us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.978458:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:2363:x1870200553149952:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1123us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562398.978484:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1783562398.978673:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 166 00000100:00100000:3.0:1783562398.983653:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562398.983778:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553150336 00000100:00100000:2.0:1783562398.983795:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553150336 00000100:00100000:2.0:1783562398.983873:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:2.0:1783562398.983887:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11453:x1870200553150336:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562398.984350:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11453:x1870200553150336:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 462us (709us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783562398.984361:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1783562399.085171:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562399.085681:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553150592 00000100:00100000:1.0:1783562399.085727:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553150592 00000100:00100000:1.0:1783562399.085849:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 167 00000100:00100000:1.0:1783562399.085862:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11471:x1870200553150592:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:1.0:1783562399.085905:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562399.085940:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21445 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.086125:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88999 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.086146:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.086163:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562399.086183:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000100:00080000:3.0:1783562399.086293:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783562399.086459:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21445 expref: 38 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.086488:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21445 expref: 37 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.086500:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:1.0:1783562399.086504:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783562399.086509:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682000, rc 0) 00000100:00100000:1.0:1783562399.086631:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11471:x1870200553150592:12345-192.168.204.4@tcp:101:cat.0 Request processed in 771us (1478us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1783562399.086641:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 167 00000100:00100000:3.0:1783562399.109713:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562399.112040:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553150720 00000100:00100000:2.0:1783562399.112071:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553150720 00000100:00100000:2.0:1783562399.112378:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 168 00000100:00100000:2.0:1783562399.112394:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11472:x1870200553150720:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562399.112460:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562399.112499:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b889a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2144c expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.112659:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.112710:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.112730:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562399.113087:0:12218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783562399.113093:0:12218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562399.113464:0:12218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.113509:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b889a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2144c expref: 39 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.113531:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2144c expref: 38 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562399.113541:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562399.113544:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562399.113548:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c800, rc 0) 00000100:00100000:2.0:1783562399.113765:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11472:x1870200553150720:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1375us (4070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562399.113774:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 168 00000100:00100000:2.0:1783562399.118936:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562399.119078:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151104 00000100:00100000:1.0:1783562399.119091:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151104 00000100:00100000:1.0:1783562399.119155:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:1.0:1783562399.119165:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11472:x1870200553151104:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:1.0:1783562399.119610:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11472:x1870200553151104:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 445us (704us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783562399.119618:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:1.0:1783562399.123703:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562399.123846:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151232 00000100:00100000:0.0:1783562399.123870:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151232 00000100:00100000:0.0:1783562399.124048:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:0.0:1783562399.124065:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11472:x1870200553151232:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:0.0:1783562399.124094:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783562399.124135:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b8893e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21430 expref: 39 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.124184:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88999 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21445 expref: 38 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.124198:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213f1 expref: 37 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.124211:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfce234e400) 00010000:00010000:0.0:1783562399.124233:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562399.124505:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11472:x1870200553151232:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 443us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562399.124517:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562399.127892:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562399.128120:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151360 00000100:00100000:1.0:1783562399.128139:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151360 00000100:00100000:1.0:1783562399.128243:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 169 00000100:00100000:1.0:1783562399.128259:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11472:x1870200553151360:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:1.0:1783562399.128674:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.128703:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562399.128723:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562399.129221:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1783562399.129390:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11472:x1870200553151360:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 1129us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562399.129429:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 169 00000100:00100000:2.0:1783562399.145928:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562399.146057:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151488 00000100:00100000:0.0:1783562399.146072:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151488 00000100:00100000:0.0:1783562399.146158:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 170 00000100:00100000:0.0:1783562399.146172:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11474:x1870200553151488:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562399.146206:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562399.146242:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b889bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21453 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146441:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146463:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146480:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146502:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146510:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.146518:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147051:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147065:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147073:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562399.147128:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783562399.147133:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562399.147162:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147190:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147201:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147207:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147214:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147220:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562399.147226:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147235:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147254:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562399.147259:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562399.147264:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147272:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147291:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147297:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147312:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147317:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562399.147320:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147325:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147333:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234e400) 00010000:00010000:0.0:1783562399.147335:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562399.147338:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147344:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147399:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b889bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 38 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147453:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 37 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562399.147460:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:0.0:1783562399.147462:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562399.147465:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562399.147588:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11474:x1870200553151488:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1418us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562399.147618:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 170 00010000:00010000:2.0:1783562399.670761:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783562399.671453:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1783562399.671491:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:1.0:1783562399.735627:0:12261:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783562399.735642:0:12261:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562399.735689:0:12261:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783562399.735693:0:12261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783562400.119264:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562400.119281:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562400.119393:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1783562400.119443:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783562400.120101:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563626752:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562400.120289:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562400.123779:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563626752:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783562400.125624:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.125884:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151616 00000100:00100000:2.0:1783562400.125902:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151616 00000100:00100000:2.0:1783562400.126017:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 171 00000100:00100000:2.0:1783562400.126034:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11486:x1870200553151616:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562400.126125:0:12218:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562400.126329:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11486:x1870200553151616:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 299us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562400.126341:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 171 00000100:00100000:2.0:1783562400.131538:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.131672:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553151744 00000100:00100000:1.0:1783562400.131688:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553151744 00000100:00100000:1.0:1783562400.131773:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 172 00000100:00100000:1.0:1783562400.131785:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11486:x1870200553151744:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.131882:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.131905:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.131929:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.131950:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.131959:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.131967:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132007:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132017:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132026:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562400.132072:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783562400.132095:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562400.132112:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132130:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132140:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132149:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132156:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.132162:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132170:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132183:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:1.0:1783562400.132186:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562400.132191:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132197:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b889d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132212:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132218:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132235:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132240:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.132244:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132250:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132260:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bfcc9774d00) 00010000:00010000:1.0:1783562400.132262:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562400.132265:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132272:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b889df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132289:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132296:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132303:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132310:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.132312:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132329:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132338:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562400.132340:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562400.132344:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.132349:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b889e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.132531:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11486:x1870200553151744:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 743us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.132544:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 172 00000100:00100000:1.0:1783562400.137798:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.138020:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553152000 00000100:00100000:0.0:1783562400.138038:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553152000 00000100:00100000:0.0:1783562400.138226:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 173 00000100:00100000:0.0:1783562400.138242:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11486:x1870200553152000:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562400.138289:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562400.138333:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2145a expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138545:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138569:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138599:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562400.138617:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783562400.138805:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138837:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138846:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138854:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562400.138859:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138868:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138885:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:0.0:1783562400.138889:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562400.138895:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138901:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b889f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138967:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2145a expref: 39 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138978:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:0.0:1783562400.138980:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562400.138984:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b889ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2145a expref: 39 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.138996:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:0.0:1783562400.139255:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152000:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1481us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1783562400.139299:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 173 00000100:00100000:0.0:1783562400.145667:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.146182:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553152128 00000100:00100000:2.0:1783562400.146197:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553152128 00000100:00100000:2.0:1783562400.146294:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 174 00000100:00100000:2.0:1783562400.146310:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152128:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562400.146370:0:12218:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562400.146704:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152128:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 396us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562400.146715:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 174 00000100:00100000:2.0:1783562400.152458:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.152654:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553152384 00000100:00100000:1.0:1783562400.152674:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553152384 00000100:00100000:1.0:1783562400.152787:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 175 00000100:00100000:1.0:1783562400.152802:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152384:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.152839:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562400.152844:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783562400.152889:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b889ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2144c expref: 38 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.152921:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562400.152928:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562400.152947:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21461 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783562400.154158:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1783562400.154598:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88a09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.154623:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.154640:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.154747:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21461 expref: 40 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.154771:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21461 expref: 39 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.154781:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc9774d00) 00010000:00010000:1.0:1783562400.154785:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562400.154789:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682c00, rc 0) 00000100:00100000:1.0:1783562400.154916:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11486:x1870200553152384:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 2117us (2531us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1783562400.154927:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 175 00000100:00100000:1.0:1783562400.159081:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.160211:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553152640 00000100:00100000:0.0:1783562400.160230:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553152640 00000100:00100000:0.0:1783562400.160307:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 176 00000100:00100000:0.0:1783562400.160320:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11486:x1870200553152640:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783562400.160433:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562400.160472:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21461 expref: 39 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.160496:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc9774d00) 00010000:00010000:0.0:1783562400.160511:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562400.160543:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.160561:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.160584:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.162220:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.162251:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.162266:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163036:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163050:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163059:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163067:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562400.163073:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163083:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163100:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562400.163104:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562400.163110:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163117:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163130:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163137:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163144:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163157:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562400.163171:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163179:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163188:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xab970eac (ffff9bfce234e800) 00010000:00010000:0.0:1783562400.163191:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562400.163194:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.163200:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xab970eac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.163320:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152640:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 2997us (4251us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783562400.163331:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 176 00000100:00100000:0.0:1783562400.166865:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.166956:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553152768 00000100:00100000:2.0:1783562400.166970:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553152768 00000100:00100000:2.0:1783562400.167079:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 177 00000100:00100000:2.0:1783562400.167106:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11486:x1870200553152768:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562400.167134:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562400.167165:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88a25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21468 expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167209:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167240:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167254:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167370:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 40 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167390:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 39 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.167436:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:2.0:1783562400.167444:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562400.167448:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c600, rc 0) 00000100:00100000:2.0:1783562400.167516:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11486:x1870200553152768:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 427us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562400.167525:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 177 00000100:00100000:3.0:1783562400.171588:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.171706:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153024 00000100:00100000:1.0:1783562400.171725:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153024 00000100:00100000:1.0:1783562400.171814:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 178 00000100:00100000:1.0:1783562400.171828:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11486:x1870200553153024:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.172028:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.172051:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.172070:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562400.172690:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1783562400.172710:0:5756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209429306240ns, next at 210429301518ns, rc = 0 00000004:00010000:1.0:1783562400.172852:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4517969 reply state 00000000899b9b1f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.172865:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562400.173020:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:11486:x1870200553153024:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1192us (1455us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1783562400.173030:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 178 00010000:00010000:1.0:1783562400.175127:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175146:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175155:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175163:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.175169:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175303:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175334:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562400.175339:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562400.175348:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.175355:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.178807:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.179068:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153152 00000100:00100000:0.0:1783562400.179086:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153152 00000100:00100000:0.0:1783562400.179295:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 179 00000100:00100000:0.0:1783562400.179311:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:11486:x1870200553153152:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562400.179360:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562400.179435:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2146f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.179531:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 41 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.179597:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 41 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.179628:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:0.0:1783562400.179632:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562400.179636:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562400.179747:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:11486:x1870200553153152:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 440us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562400.179757:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 179 00000100:00100000:3.0:1783562400.183862:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.184349:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153280 00000100:00100000:2.0:1783562400.184366:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153280 00000100:00100000:2.0:1783562400.184527:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:2.0:1783562400.184541:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553153280:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783562400.184695:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562400.185538:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553153280:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 989us (1682us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783562400.185564:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:3.0:1783562400.190481:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.190670:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153536 00000100:00100000:2.0:1783562400.190716:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153536 00000100:00100000:2.0:1783562400.190819:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:2.0:1783562400.190837:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+41:11486:x1870200553153536:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562400.190890:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.190940:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.191239:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:11486:x1870200553153536:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 407us (835us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783562400.191249:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:3.0:1783562400.191342:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153664 00000100:00100000:3.0:1783562400.191348:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153664 00000100:00100000:3.0:1783562400.191390:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 265 00000100:00100000:3.0:1783562400.191399:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553153664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562400.191462:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553153664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 64us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562400.191469:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 265 00000100:00100000:3.0:1783562400.191598:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.191635:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153792 00000100:00100000:0.0:1783562400.191641:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153792 00000100:00100000:0.0:1783562400.191694:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:0.0:1783562400.191705:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553153792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1783562400.191740:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562400.191750:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553153792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562400.191758:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:1.0:1783562400.191894:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553153920 00000100:00100000:1.0:1783562400.191899:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553153920 00000100:00100000:1.0:1783562400.192008:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:1.0:1783562400.192020:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553153920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1783562400.192033:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562400.192067:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553153920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.192075:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:0.0:1783562400.195824:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562400.196289:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154176 00000100:00100000:3.0:1783562400.196307:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154176 00000100:00100000:1.0:1783562400.196694:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 180 00000100:00100000:1.0:1783562400.196716:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:11486:x1870200553154176:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783562400.196939:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:11486:x1870200553154176:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 231us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.196949:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 180 00000100:00100000:2.0:1783562400.200973:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.201240:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154304 00000100:00100000:0.0:1783562400.201260:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154304 00000100:00100000:1.0:1783562400.201624:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 181 00000100:00100000:1.0:1783562400.201643:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:11486:x1870200553154304:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.201697:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562400.201774:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21476 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.201945:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.201973:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.202001:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562400.202077:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562400.202242:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.202309:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21476 expref: 44 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.202336:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21476 expref: 43 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.202348:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562400.202352:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783562400.202358:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683600, rc 0) 00000100:00100000:1.0:1783562400.202592:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11486:x1870200553154304:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 955us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.202601:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 181 00000100:00100000:3.0:1783562400.209727:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.210256:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154432 00000100:00100000:0.0:1783562400.210277:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154432 00000100:00100000:0.0:1783562400.210483:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:0.0:1783562400.210499:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553154432:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562400.210567:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562400.210608:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2147d expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562400.210656:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f009e, blocks: 0x1 00010000:00010000:0.0:1783562400.210695:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=209s v=(0 0) 00010000:00010000:0.0:1783562400.210702:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562400.210716:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 8 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.210743:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 8 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.210762:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9e00, rc 0) 00000100:00100000:0.0:1783562400.210868:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553154432:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 373us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562400.210878:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:0.0:1783562400.218118:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.218211:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154688 00000100:00100000:1.0:1783562400.218231:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154688 00000100:00100000:1.0:1783562400.218363:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 182 00000100:00100000:1.0:1783562400.218376:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11486:x1870200553154688:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783562400.218615:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11486:x1870200553154688:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 241us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.218625:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 182 00000100:00100000:3.0:1783562400.222221:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.222328:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154816 00000100:00100000:2.0:1783562400.222347:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154816 00000100:00100000:2.0:1783562400.222477:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:2.0:1783562400.222491:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:11486:x1870200553154816:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562400.222515:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562400.222540:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21484 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.222593:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.222609:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562400.222615:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562400.222620:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.222665:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.222714:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.222731:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563626880:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562400.223142:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc58806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562400.225644:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563626880:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562400.225692:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.225726:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ce00, rc 0) 00000100:00100000:2.0:1783562400.225793:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:11486:x1870200553154816:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 3305us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562400.225805:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:0.0:1783562400.229047:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.229504:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553154944 00000100:00100000:1.0:1783562400.229520:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553154944 00010000:00010000:1.0:1783562400.229604:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.229674:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:1.0:1783562400.229688:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553154944:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562400.229721:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562400.229766:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.229784:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.229818:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b88a4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2147d expref: 9 pid: 6549 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.229841:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562400.229846:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562400.229856:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.229893:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.229959:0:5739:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.229981:0:5739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1870200563627008:192.168.204.4@tcp:105: 00000100:00100000:1.0:1783562400.230181:0:5739:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00840 going to sleep for 11 seconds 00000100:00100000:1.0:1783562400.232465:0:5739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1870200563627008:192.168.204.4@tcp:105: 00010000:00010000:1.0:1783562400.232507:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562400.232707:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553154944:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 3020us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.232723:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:3.0:1783562400.234125:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.234340:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155072 00000100:00100000:0.0:1783562400.234355:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155072 00002000:00100000:0.0:1783562400.234466:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bfcef5d7800 x1870200553155072/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:241/0 lens 504/0 e 0 to 0 dl 1783562411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783562400.234479:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef5d7800 with x1870200553155072 ext(0->8) 00002000:00010000:0.0:1783562400.234487:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef5d7800 00000100:00100000:0.0:1783562400.234516:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:0.0:1783562400.234546:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553155072:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783562400.235270:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2363:x1870200553155072:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 721us (1147us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783562400.235280:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00002000:00100000:0.0:1783562400.235288:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bfcef5d7800 x1870200553155072/t4294967314(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:241/0 lens 504/448 e 0 to 0 dl 1783562411 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783562400.235297:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef5d7800 with x1870200553155072 ext(0->8) 00002000:00010000:0.0:1783562400.235303:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef5d7800 00000100:00100000:0.0:1783562400.237382:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.238183:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155200 00000100:00100000:1.0:1783562400.238204:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155200 00000100:00100000:1.0:1783562400.238307:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 183 00000100:00100000:1.0:1783562400.238324:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11486:x1870200553155200:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783562400.269810:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11486:x1870200553155200:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 31471us (32426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562400.269827:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 183 00000001:00080000:3.0:1783562400.269984:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:3.0:1783562400.270029:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1783562400.270054:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1783562400.270060:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1783562400.270143:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1783562400.270241:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1783562400.270257:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783562400.270552:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783562400.270582:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563627136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783562400.270647:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562400.270744:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563627136 00000100:00100000:0.0:1783562400.270757:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563627136 00000100:00080000:1.0:1783562400.270872:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562400.270903:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783562400.270916:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563627136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783562400.271109:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783562400.271114:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783562398 00002000:00010000:0.0:1783562400.271116:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783562400.271118:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783562398 -> 1783562398 00002000:00010000:0.0:1783562400.271120:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783562400.271166:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563627136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (518us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783562400.271172:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1783562400.271658:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcd914c000/2, rc 0, transno 4294967315 00000100:00100000:1.0:1783562400.271682:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563627136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783562400.273528:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.273637:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155328 00000100:00100000:0.0:1783562400.273650:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155328 00000100:00100000:0.0:1783562400.273799:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:0.0:1783562400.273811:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2364:x1870200553155328:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783562400.313961:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1783562400.313980:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1783562400.314289:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553155328:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 40471us (40761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562400.314304:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:0.0:1783562400.317586:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.317696:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155584 00000100:00100000:1.0:1783562400.317709:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155584 00000100:00100000:1.0:1783562400.317792:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 184 00000100:00100000:1.0:1783562400.317808:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:11486:x1870200553155584:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.317885:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562400.317923:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21476 expref: 18 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.317943:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562400.317949:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562400.317990:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.318005:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.318017:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562400.318305:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001efd8104 reply state 0000000074532317 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.318315:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562400.318468:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:11486:x1870200553155584:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 664us (901us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1783562400.318476:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 184 00010000:00010000:1.0:1783562400.321395:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.321430:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1783562400.321463:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.321472:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.321480:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.321486:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.321495:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.321519:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562400.321523:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562400.321529:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.321535:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.321631:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155712 00000100:00100000:2.0:1783562400.321643:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155712 00000100:00100000:2.0:1783562400.321708:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:2.0:1783562400.321721:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553155712:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783562400.322035:0:6549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783562400.322039:0:6549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783562398 -> 1783562397 00002000:00010000:2.0:1783562400.322041:0:6549:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783562396 00002000:00010000:2.0:1783562400.322050:0:6549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783562398 -> 1783562397 00002000:00010000:2.0:1783562400.322052:0:6549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783562400.322122:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553155712:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 403us (725us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783562400.322130:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:0.0:1783562400.327221:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.327395:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553155968 00000100:00100000:2.0:1783562400.327445:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553155968 00000100:00100000:3.0:1783562400.327564:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 185 00000100:00100000:3.0:1783562400.327588:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:11486:x1870200553155968:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783562400.327671:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.327690:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 18 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.327701:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.327746:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 18 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.327762:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 18 pid: 12218 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.327780:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef5d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563627264:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562400.328106:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562400.331518:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef5d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563627264:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562400.331562:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.331985:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562400.332114:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156096 00000100:00100000:3.0:1783562400.332128:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156096 00010000:00010000:3.0:1783562400.332185:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 19 pid: 12218 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.332264:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:3.0:1783562400.332278:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:2364:x1870200553156096:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562400.332301:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562400.332312:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 19 pid: 12218 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332328:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 19 pid: 12218 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332361:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21468 expref: 19 pid: 12218 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332382:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:3.0:1783562400.332388:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332400:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332454:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562400.332489:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562400.332540:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332554:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.332566:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:2364:x1870200553156096:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 290us (581us total) trans 0 rc 0/0 00010000:00010000:2.0:1783562400.332610:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332619:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332627:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332633:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562400.332638:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332646:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332685:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:2.0:1783562400.332689:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783562400.332694:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.332719:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88a64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.332723:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:2.0:1783562400.332821:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:11486:x1870200553155968:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 5235us (5613us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783562400.332832:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 185 00000100:00100000:3.0:1783562400.336320:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562400.336692:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156224 00000100:00100000:2.0:1783562400.336712:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156224 00000100:00100000:2.0:1783562400.336786:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:2.0:1783562400.336797:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2361:x1870200553156224:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783562400.336859:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.336880:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.336889:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562400.336893:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562400.336898:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.336937:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.336964:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 8 pid: 6547 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.336981:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563627392:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562400.337287:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd1917e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562400.341101:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563627392:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562400.341134:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.342873:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.343159:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156352 00000100:00100000:0.0:1783562400.343175:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156352 00010000:00010000:0.0:1783562400.343239:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.343334:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:0.0:1783562400.343347:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553156352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562400.343367:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562400.343397:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.343445:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.343481:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db4956a/0x4738ba0933b88a56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21484 expref: 9 pid: 6547 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.343513:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562400.343519:0:11471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562400.343527:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.343561:0:11471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.343621:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562400.343713:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553156352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 367us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562400.343723:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00010000:00010000:1.0:1783562400.344597:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344620:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344670:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344705:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344715:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344721:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562400.344727:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344736:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344760:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.344767:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad1cbe25/0x4738ba0933b88a6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.344881:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553156224:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 8080us (8571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.344892:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:2.0:1783562400.347238:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.347326:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156608 00000100:00100000:1.0:1783562400.347342:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156608 00000100:00100000:1.0:1783562400.347458:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 186 00000100:00100000:1.0:1783562400.347481:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+17:11486:x1870200553156608:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783562400.347561:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347590:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347604:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347810:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347822:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347831:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347868:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 18 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.347883:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 18 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.347898:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563627520:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562400.348060:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562400.350060:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563627520:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562400.350095:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.350565:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.350742:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156736 00000100:00100000:1.0:1783562400.350751:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156736 00010000:00010000:1.0:1783562400.350810:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 19 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.350907:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:1.0:1783562400.350919:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:2363:x1870200553156736:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562400.350937:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562400.350945:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 19 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.350960:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 19 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.350984:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88a3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2146f expref: 19 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.351015:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:1.0:1783562400.351022:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.351033:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.351042:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.351072:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562400.351148:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:2363:x1870200553156736:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 230us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562400.351157:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00010000:00010000:2.0:1783562400.351213:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.351222:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562400.351523:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1783562400.351746:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1783562400.351796:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1783562400.351930:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563627648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783562400.352007:0:5754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562400.352037:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc3017b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562400.352554:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563627648 00000100:00100000:3.0:1783562400.352576:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563627648 00000100:00100000:3.0:1783562400.352642:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562400.352656:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563627648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783562400.352799:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563627648:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562400.352809:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562400.352860:0:5754:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1783562400.352868:0:5754:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcd914c000, transno 4294967315 00000100:00100000:2.0:1783562400.352918:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563627648:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783562400.353957:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1783562400.354315:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563627776:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783562400.354371:0:5754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562400.354436:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563627776 00000100:00100000:1.0:1783562400.354443:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563627776 00000100:00100000:2.0:1783562400.354563:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562400.354621:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562400.354642:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563627776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783562400.354857:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5754:x1870200563627776:12345-0@lo:1000:mdt00_000.0 Request processed in 227us (486us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783562400.354866:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783562400.354937:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563627776:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783562400.354970:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.354981:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355074:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355082:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562400.355089:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355097:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355118:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc4c37900) 00010000:00010000:2.0:1783562400.355121:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562400.355125:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355131:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88a79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355170:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355186:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355193:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355198:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562400.355202:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355208:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355218:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:2.0:1783562400.355220:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562400.355223:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355228:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b889b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355255:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355274:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 21 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355283:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355310:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 21 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.355335:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 21 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562400.355347:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563627904:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562400.355694:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562400.359526:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563627904:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562400.359591:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562400.360109:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562400.360657:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553156864 00000100:00100000:0.0:1783562400.360667:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553156864 00010000:00010000:0.0:1783562400.360720:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 22 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.360776:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:0.0:1783562400.360789:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:2363:x1870200553156864:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562400.360806:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562400.360814:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 22 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360828:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 22 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360853:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b889d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21453 expref: 22 pid: 6572 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360871:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:0.0:1783562400.360892:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360905:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360913:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562400.360943:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562400.360970:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.360982:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.360998:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361007:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361017:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361026:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.361040:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562400.361045:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2363:x1870200553156864:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 255us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562400.361054:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00010000:00010000:1.0:1783562400.361120:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361132:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562400.361136:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562400.361141:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361149:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88a80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361164:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361171:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361178:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361185:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562400.361190:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361197:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361205:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562400.361208:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783562400.361217:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.361224:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562400.361510:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11486:x1870200553156608:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 14030us (14358us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1783562400.361521:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 186 00000020:00080000:1.0:1783562400.361525:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783562400.361618:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562400.361624:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562400.362126:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1783562400.362134:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562400.365398:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562400.365803:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553157120 00000100:00100000:1.0:1783562400.365820:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553157120 00000100:00100000:1.0:1783562400.365900:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:1.0:1783562400.365910:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5194850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11486:x1870200553157120:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783562400.367047:0:5757:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783562400.367247:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1783562400.367312:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367333:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367348:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367359:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367367:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367373:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562400.367452:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562400.367627:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562400.367636:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.367646:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562400.367651:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.367663:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.367679:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bfcc9774900) 00010000:00010000:2.0:1783562400.367682:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783562400.367687:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.367692:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88a87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562400.367721:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562400.367723:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562400.367725:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562400.367798:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5194850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:11486:x1870200553157120:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1812us (2340us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1783562400.367810:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00000020:00080000:1.0:1783562400.367818:0:5757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783562400.695271:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562401.337034:0:12314:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783562401.337050:0:12314:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562401.337117:0:12314:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783562401.337125:0:12314:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783562401.399087:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562401.399103:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562401.399510:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783562401.399518:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562401.415872:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.415964:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553157376 00000100:00100000:1.0:1783562401.415986:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553157376 00000100:00100000:1.0:1783562401.416105:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 187 00000100:00100000:1.0:1783562401.416119:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:11504:x1870200553157376:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562401.416164:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562401.416201:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88a8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2148b expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783562401.416203:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783562401.416660:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b88a95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.416683:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b88a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.416703:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b88a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562401.416720:0:12218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1783562401.417004:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2148b expref: 25 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.417026:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b88a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2148b expref: 24 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.417051:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562401.417055:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562401.417060:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683400, rc 0) 00000100:00100000:1.0:1783562401.417168:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11504:x1870200553157376:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1052us (1318us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1783562401.417180:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 187 00000100:00100000:0.0:1783562401.424675:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.424766:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553157504 00000100:00100000:2.0:1783562401.424786:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553157504 00000100:00100000:2.0:1783562401.424880:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 188 00000100:00100000:2.0:1783562401.424897:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11504:x1870200553157504:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:2.0:1783562401.425014:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.425044:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.425066:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.425097:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.425105:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.425111:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426018:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426032:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426043:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562401.426130:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426151:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426158:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426166:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426173:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.426179:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426187:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426205:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562401.426208:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.426213:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426220:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426232:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426238:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426252:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426258:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.426261:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426268:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426277:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc4c37900) 00010000:00010000:2.0:1783562401.426280:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.426284:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426290:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426314:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426322:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426329:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426334:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.426338:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426358:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426367:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562401.426370:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.426374:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.426381:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.426725:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11504:x1870200553157504:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 1821us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.426741:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 188 00000100:00100000:2.0:1783562401.458115:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.458477:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553157760 00000100:00100000:1.0:1783562401.458491:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553157760 00000100:00100000:1.0:1783562401.458569:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 189 00000100:00100000:1.0:1783562401.458584:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11507:x1870200553157760:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562401.458610:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562401.458637:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21492 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458738:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458755:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458768:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458786:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458793:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.458813:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459192:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459201:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459210:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562401.459223:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783562401.459354:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459362:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459368:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459375:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.459380:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459390:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459432:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562401.459436:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562401.459449:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459456:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459469:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459475:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459481:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459487:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.459490:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459497:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459506:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774e00) 00010000:00010000:1.0:1783562401.459509:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562401.459512:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459518:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459591:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 27 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459624:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 26 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.459633:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562401.459636:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562401.459639:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682200, rc 0) 00000100:00100000:1.0:1783562401.459724:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11507:x1870200553157760:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1144us (1619us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783562401.459734:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 189 00000100:00100000:1.0:1783562401.462756:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.462805:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553157888 00000100:00100000:2.0:1783562401.462817:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553157888 00000100:00100000:2.0:1783562401.462886:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 190 00000100:00100000:2.0:1783562401.462949:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11507:x1870200553157888:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:2.0:1783562401.463027:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463045:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463058:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463199:0:12218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463213:0:12218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463221:0:12218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463227:0:12218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.463231:0:12218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463237:0:12218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463251:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:2.0:1783562401.463254:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562401.463257:0:12218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.463263:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.463358:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11507:x1870200553157888:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 411us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.463368:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 190 00000100:00100000:1.0:1783562401.469147:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.469197:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553158144 00000100:00100000:3.0:1783562401.469210:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553158144 00000100:00100000:3.0:1783562401.469344:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:2.0:1783562401.469470:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11507:x1870200553158144:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562401.469780:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:11507:x1870200553158144:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 425us (643us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1783562401.469788:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:1.0:1783562401.493236:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.493660:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553158400 00000100:00100000:2.0:1783562401.493678:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553158400 00000100:00100000:2.0:1783562401.493743:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:2.0:1783562401.493752:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:11034:x1870200553158400:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562401.493787:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562401.493816:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ae2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21499 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.493993:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.494012:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 28 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.494023:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.494083:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 28 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.494099:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 28 pid: 5754 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.494116:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563628032:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562401.494368:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562401.497382:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563628032:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562401.497466:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562401.497605:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.497673:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553158528 00000100:00100000:1.0:1783562401.497685:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553158528 00010000:00010000:1.0:1783562401.497740:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 29 pid: 5754 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.497788:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:1.0:1783562401.497800:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:2364:x1870200553158528:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562401.497821:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562401.497830:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 29 pid: 5754 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497845:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 29 pid: 5754 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497889:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21492 expref: 29 pid: 5754 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497910:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562401.497916:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497927:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497935:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.497962:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562401.498026:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:2364:x1870200553158528:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 226us (423us total) trans 0 rc 0/0 00010000:00010000:2.0:1783562401.498034:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.498034:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00010000:00010000:2.0:1783562401.498042:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562401.498065:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783562401.498338:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88ae2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 29 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.498818:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 28 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.498829:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:2.0:1783562401.498832:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562401.498835:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1da00, rc 0) 00000100:00100000:2.0:1783562401.498889:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11034:x1870200553158400:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5137us (5670us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783562401.498898:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:0.0:1783562401.504674:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.504792:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553158784 00000100:00100000:1.0:1783562401.504806:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553158784 00000100:00100000:1.0:1783562401.504930:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 192 00000100:00100000:1.0:1783562401.504943:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11034:x1870200553158784:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:1.0:1783562401.506344:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.506374:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.506390:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562401.507129:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1783562401.507190:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007568da96 reply state 000000007c8c0bc3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.507202:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783562401.507398:0:6572:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1783562401.507633:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11034:x1870200553158784:12345-192.168.204.4@tcp:36:bash.0 Request processed in 2688us (2972us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1783562401.507645:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 192 00000020:00080000:1.0:1783562401.507652:0:6572:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783562401.510032:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1783562401.510145:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510158:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510167:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510174:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562401.510181:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510212:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510311:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:0.0:1783562401.510315:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562401.510321:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.510328:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88af7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.510468:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553158912 00000100:00100000:2.0:1783562401.510482:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553158912 00000100:00100000:2.0:1783562401.510558:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:2.0:1783562401.510569:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11034:x1870200553158912:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562401.510594:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562401.510613:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214a0 expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.510714:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a0 expref: 32 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.510730:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a0 expref: 32 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.510750:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:2.0:1783562401.510753:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562401.510757:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c800, rc 0) 00000100:00100000:2.0:1783562401.510820:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11034:x1870200553158912:12345-192.168.204.4@tcp:101:bash.0 Request processed in 252us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.510828:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:2.0:1783562401.518147:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.518322:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159040 00000100:00100000:0.0:1783562401.518334:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159040 00000100:00100000:0.0:1783562401.518488:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:0.0:1783562401.518502:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:11034:x1870200553159040:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562401.518532:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562401.518578:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214a7 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562401.518615:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4f009d, atime: 0x6a4f009c, ctime: 0x6a4f009d, blocks: 0xb 00010000:00010000:0.0:1783562401.518644:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=210s v=(0 0) 00010000:00010000:0.0:1783562401.518650:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562401.518661:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.518685:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.518730:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8a00, rc 0) 00000100:00100000:0.0:1783562401.518824:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:11034:x1870200553159040:12345-192.168.204.4@tcp:101:bash.0 Request processed in 324us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562401.518831:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:0.0:1783562401.521740:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.521842:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159168 00000100:00100000:3.0:1783562401.521865:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159168 00002000:00010000:3.0:1783562401.521941:0:6554:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1783562401.521949:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef69ad80 with x1870200553159168 ext(0->18446744073709551615) 00002000:00010000:3.0:1783562401.521979:0:6554:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef69ad80. 00000100:00100000:3.0:1783562401.522111:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562401.522134:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2362:x1870200553159168:12345-192.168.204.4@tcp:10:bash.0 00002000:00010000:3.0:1783562401.522652:0:6554:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783562401.522658:0:6554:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783562397 -> 1783562400 00002000:00010000:3.0:1783562401.522682:0:6554:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783562396 -> 1783562396 00002000:00010000:3.0:1783562401.522685:0:6554:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783562397 -> 1783562400 00002000:00010000:3.0:1783562401.522688:0:6554:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783562401.522794:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2362:x1870200553159168:12345-192.168.204.4@tcp:10:bash.0 Request processed in 670us (1066us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783562401.522804:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00002000:00010000:3.0:1783562401.522809:0:6554:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1783562401.522812:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef69ad80 with x1870200553159168 ext(0->18446744073709551615) 00002000:00010000:3.0:1783562401.522818:0:6554:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef69ad80. 00000100:00100000:3.0:1783562401.572369:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.572687:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159296 00000100:00100000:2.0:1783562401.572707:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159296 00000100:00100000:2.0:1783562401.572981:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 194 00000100:00100000:2.0:1783562401.572996:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11521:x1870200553159296:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:2.0:1783562401.573083:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573103:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573115:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573129:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573153:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573160:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573619:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573627:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573632:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562401.573664:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573673:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573677:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573681:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573685:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.573688:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573693:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573708:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562401.573710:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.573713:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573717:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88b0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573727:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573730:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573733:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573737:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.573739:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573745:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573817:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562401.573820:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.573824:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573830:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573863:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573868:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573874:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573879:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.573882:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573888:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573896:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:2.0:1783562401.573898:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.573901:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.573906:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.574004:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11521:x1870200553159296:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 1010us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.574013:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 194 00000100:00100000:2.0:1783562401.608707:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.608837:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159552 00000100:00100000:1.0:1783562401.608858:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159552 00000100:00100000:1.0:1783562401.608956:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 195 00000100:00100000:1.0:1783562401.608968:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11524:x1870200553159552:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562401.609022:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562401.609063:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214ae expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.609209:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.609232:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.609248:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.609266:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.610381:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.610394:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.611324:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.611340:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.611349:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562401.611365:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783562401.612091:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612105:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612113:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612119:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.612124:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612136:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612173:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562401.612176:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562401.612182:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612189:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612210:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612217:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612224:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612229:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.612232:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612240:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612249:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774e00) 00010000:00010000:1.0:1783562401.612251:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562401.612255:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612262:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612362:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ae expref: 35 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612380:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ae expref: 34 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.612388:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562401.612391:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783562401.612394:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682e00, rc 0) 00000100:00100000:1.0:1783562401.612614:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11524:x1870200553159552:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 3646us (3924us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1783562401.612625:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 195 00000100:00100000:0.0:1783562401.617164:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.617274:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159680 00000100:00100000:1.0:1783562401.617302:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159680 00000100:00100000:1.0:1783562401.617457:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00100000:1.0:1783562401.617473:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11524:x1870200553159680:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562401.617624:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.617653:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 34 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.617667:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.617733:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 34 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.617777:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 34 pid: 5755 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.617798:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563628160:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562401.617954:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37840 going to sleep for 11 seconds 00000100:00100000:1.0:1783562401.620642:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563628160:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562401.620802:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562401.621308:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.621381:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553159936 00000100:00100000:1.0:1783562401.621394:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553159936 00000100:00100000:1.0:1783562401.621539:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:1.0:1783562401.621567:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:9216:x1870200553159936:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783562401.622168:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:9216:x1870200553159936:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 605us (856us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783562401.622179:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:0.0:1783562401.625367:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.625658:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553160064 00000100:00100000:1.0:1783562401.625675:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553160064 00010000:00010000:1.0:1783562401.625830:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 36 pid: 5755 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.625926:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:1.0:1783562401.625942:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:2364:x1870200553160064:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562401.625970:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562401.626020:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 36 pid: 5755 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626042:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 36 pid: 5755 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626083:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b88ae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21499 expref: 36 pid: 5755 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626107:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562401.626113:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626127:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626138:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.626191:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562401.626318:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:2364:x1870200553160064:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 379us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562401.626329:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00010000:00010000:0.0:1783562401.626670:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626683:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626764:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626773:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626784:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626791:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562401.626798:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626808:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626842:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:0.0:1783562401.626846:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562401.626852:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.626858:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562401.626942:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11524:x1870200553159680:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 9471us (9803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562401.626956:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00100000:0.0:1783562401.630251:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.630780:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553160320 00000100:00100000:2.0:1783562401.630807:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553160320 00000100:00100000:2.0:1783562401.630959:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:2.0:1783562401.630992:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+34:11524:x1870200553160320:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562401.632125:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11524:x1870200553160320:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 1127us (1885us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783562401.632151:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:2.0:1783562401.699062:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.699272:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553160576 00000100:00100000:3.0:1783562401.699300:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553160576 00000100:00100000:3.0:1783562401.699530:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 197 00000100:00100000:3.0:1783562401.699557:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+35:11535:x1870200553160576:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:3.0:1783562401.699608:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562401.699648:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214b5 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699815:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699842:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699862:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699882:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699910:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.699917:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700591:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700606:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700617:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562401.700636:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783562401.700817:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700826:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700834:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700842:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562401.700848:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700857:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700888:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:3.0:1783562401.700891:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562401.700899:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700908:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700931:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700938:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700945:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700951:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562401.700954:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700962:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700971:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562401.700974:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562401.700977:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.700985:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.701075:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214b5 expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.701098:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214b5 expref: 37 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.701108:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:3.0:1783562401.701110:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562401.701113:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:3.0:1783562401.701257:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11535:x1870200553160576:12345-192.168.204.4@tcp:101:cat.0 Request processed in 1711us (2223us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783562401.701268:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 197 00000100:00100000:0.0:1783562401.706963:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.707114:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553160832 00000100:00100000:1.0:1783562401.707129:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553160832 00000100:00100000:1.0:1783562401.707213:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:1.0:1783562401.707226:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11535:x1870200553160832:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:1.0:1783562401.707739:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11535:x1870200553160832:12345-192.168.204.4@tcp:35:cat.0 Request processed in 511us (793us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1783562401.707789:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 54 00010000:00010000:3.0:1783562401.719318:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562401.727772:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.728155:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.728209:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.728302:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161344 00000100:00100000:3.0:1783562401.728320:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161344 00000100:00100000:3.0:1783562401.728447:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:1.0:1783562401.728451:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161088 00000100:00100000:1.0:1783562401.728459:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161088 00000100:00100000:3.0:1783562401.728462:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2361:x1870200553161344:12345-192.168.204.4@tcp:16:kworker.0 00000100:00100000:1.0:1783562401.728514:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 198 00000100:00100000:1.0:1783562401.728525:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11536:x1870200553161088:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1783562401.728619:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783562401.728672:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336a00/0x4738ba0933b88b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214b5 expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728705:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ae expref: 37 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728723:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a0 expref: 36 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728739:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562401.728760:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562401.728796:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728818:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728834:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728858:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728903:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.728911:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.729210:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161216 00000100:00100000:2.0:1783562401.729218:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161216 00002000:00100000:2.0:1783562401.729260:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9bfcf6638700 x1870200553161216/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:242/0 lens 496/0 e 0 to 0 dl 1783562412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562401.729272:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6638700 with x1870200553161216 ext(0->7) 00002000:00010000:2.0:1783562401.729279:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6638700 00000100:00100000:2.0:1783562401.729314:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562401.729323:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2362:x1870200553161216:12345-192.168.204.4@tcp:4:cat.0 00010000:00010000:1.0:1783562401.729465:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.729475:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.729483:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562401.730336:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1783562401.730352:0:6572:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 210986948707ns, next at 211986943367ns, rc = 0 00010000:00010000:1.0:1783562401.730463:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730476:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730488:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730496:0:6572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730504:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730520:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730539:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562401.730579:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730586:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730593:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730600:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.730607:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730618:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730635:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774800) 00010000:00010000:1.0:1783562401.730638:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783562401.730644:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730650:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b88b7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730679:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730684:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730698:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730705:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562401.730708:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730714:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730724:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562401.730726:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562401.730730:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.730738:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562401.730749:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000665bcae7 reply state 000000004cd4ec48 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.730764:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562401.730909:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+37:11536:x1870200553161088:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2380us (3156us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1783562401.730921:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 198 00010000:00010000:2.0:1783562401.730975:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562401.730985:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.730993:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562401.730998:0:7446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.731005:0:7446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.731016:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bfcc9774800) 00010000:00010000:2.0:1783562401.731018:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783562401.731029:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.731035:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.731057:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562401.731059:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562401.731061:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562401.731360:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2362:x1870200553161216:12345-192.168.204.4@tcp:4:cat.0 Request processed in 2036us (3202us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783562401.731373:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00002000:00100000:2.0:1783562401.731390:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9bfcf6638700 x1870200553161216/t4294967319(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:242/0 lens 496/448 e 0 to 0 dl 1783562412 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562401.731427:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6638700 with x1870200553161216 ext(0->7) 00002000:00010000:2.0:1783562401.731434:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf6638700 00010000:00010000:2.0:1783562401.736796:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736832:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736843:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736852:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562401.736863:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736874:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736933:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774e00) 00010000:00010000:2.0:1783562401.736937:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562401.736944:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.736953:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88b75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562401.774667:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1783562401.774707:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1783562401.774714:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:3.0:1783562401.774988:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2361:x1870200553161344:12345-192.168.204.4@tcp:16:kworker.0 Request processed in 46520us (46766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562401.775003:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:1.0:1783562401.809678:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.809863:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161600 00000100:00100000:0.0:1783562401.809880:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161600 00000100:00100000:0.0:1783562401.810032:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 199 00000100:00100000:0.0:1783562401.810046:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+36:11542:x1870200553161600:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562401.810081:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562401.810112:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88b8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214bc expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810295:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810336:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810354:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810377:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810384:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.810392:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562401.812175:0:5754:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783562401.812475:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812498:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812514:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812577:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812585:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812888:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812911:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562401.812918:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812928:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812948:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562401.812952:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562401.812960:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.812967:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88b91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562401.812990:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f10bb019 reply state 00000000f235bab8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562401.813003:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783562401.813054:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88b8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 39 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.813071:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 38 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.813080:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562401.813082:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562401.813085:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562401.813301:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11542:x1870200553161600:12345-192.168.204.4@tcp:101:bash.0 Request processed in 3256us (3709us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783562401.813321:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 199 00010000:00010000:0.0:1783562401.816988:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817016:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817025:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817032:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562401.817039:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817049:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817074:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562401.817078:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562401.817084:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.817091:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88b98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.823745:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.824276:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161728 00000100:00100000:2.0:1783562401.824298:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161728 00000100:00100000:2.0:1783562401.824435:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:2.0:1783562401.824449:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553161728:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562401.824468:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562401.824491:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214c3 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562401.824521:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562401.824631:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=211s v=(0 0) 00010000:00010000:2.0:1783562401.824637:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562401.824649:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 6 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.824669:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 6 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.824684:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d200, rc 0) 00000100:00100000:2.0:1783562401.825159:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2361:x1870200553161728:12345-192.168.204.4@tcp:101:bash.0 Request processed in 712us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.825181:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:2.0:1783562401.833025:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.833184:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161856 00000100:00100000:0.0:1783562401.833202:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161856 00000100:00100000:0.0:1783562401.833282:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:0.0:1783562401.833294:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:11542:x1870200553161856:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562401.833319:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562401.833694:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214ca expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.833731:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.833742:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562401.833747:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562401.833753:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.833791:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.833806:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562401.833822:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf663b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563628288:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562401.833965:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562401.837722:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf663b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6547:1870200563628288:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562401.837775:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.837804:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:1.0:1783562401.837895:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.837978:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf70d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:11542:x1870200553161856:12345-192.168.204.4@tcp:101:bash.0 Request processed in 4683us (4960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562401.838013:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:3.0:1783562401.838028:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553161984 00000100:00100000:3.0:1783562401.838043:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553161984 00010000:00010000:3.0:1783562401.838105:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562401.838157:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:3.0:1783562401.838182:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553161984:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562401.838208:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562401.838262:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.838645:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.838684:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046dc070e/0x4738ba0933b88bad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214c3 expref: 7 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.838704:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562401.838710:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562401.838722:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.838739:0:5741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.838797:0:5741:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562401.838816:0:5741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5741:1870200563628416:192.168.204.4@tcp:105: 00000100:00100000:3.0:1783562401.839797:0:5741:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562401.842350:0:5741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5741:1870200563628416:192.168.204.4@tcp:105: 00010000:00010000:3.0:1783562401.842591:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562401.842691:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553161984:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 4509us (5109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562401.842708:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:1.0:1783562401.845297:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562401.845480:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553162240 00000100:00100000:2.0:1783562401.845497:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553162240 00000100:00100000:2.0:1783562401.846644:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:2.0:1783562401.846661:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+38:11542:x1870200553162240:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:2.0:1783562401.847332:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11542:x1870200553162240:12345-192.168.204.4@tcp:35:bash.0 Request processed in 674us (2054us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783562401.847342:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:0.0:1783562401.965696:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.965887:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553162368 00000100:00100000:3.0:1783562401.965909:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553162368 00000100:00100000:3.0:1783562401.966014:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 200 00000100:00100000:3.0:1783562401.966031:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+39:11558:x1870200553162368:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562401.966077:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562401.966103:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214d1 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.966287:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.966308:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.966324:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562401.966493:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783562401.966497:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562401.966530:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.966573:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d1 expref: 41 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.966602:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d1 expref: 40 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.967901:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:3.0:1783562401.967905:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562401.967911:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337400, rc 0) 00000100:00100000:3.0:1783562401.968022:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf663b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:11558:x1870200553162368:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1992us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562401.968031:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 200 00000100:00100000:1.0:1783562401.972484:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.972700:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553162624 00000100:00100000:0.0:1783562401.972727:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553162624 00000100:00100000:0.0:1783562401.972922:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 201 00000100:00100000:0.0:1783562401.972937:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+40:11558:x1870200553162624:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562401.972975:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562401.973006:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88bc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214d8 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.974400:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.974443:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.974458:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562401.974473:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783562401.975158:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88bc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d8 expref: 43 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.975187:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d8 expref: 42 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.975197:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562401.975200:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562401.975218:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9c00, rc 0) 00000100:00100000:0.0:1783562401.975317:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+42:11558:x1870200553162624:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 2383us (2849us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783562401.975326:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 201 00000100:00100000:1.0:1783562401.978820:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.979075:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.979153:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553162752 00000100:00100000:0.0:1783562401.979170:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553162752 00000100:00100000:2.0:1783562401.979219:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163008 00000100:00100000:2.0:1783562401.979226:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163008 00000100:00100000:0.0:1783562401.979303:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562401.979309:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:0.0:1783562401.979321:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:2363:x1870200553162752:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783562401.979324:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11558:x1870200553163008:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562401.979357:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562401.979363:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562401.979392:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214df expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.979397:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d8 expref: 43 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562401.979466:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562401.979471:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562401.979556:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:2363:x1870200553162752:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 239us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562401.979566:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00010000:00010000:2.0:1783562401.979589:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.979606:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.979621:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562401.979640:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783562401.980156:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214df expref: 44 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.980173:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214df expref: 43 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.980181:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:2.0:1783562401.980184:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783562401.980187:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c800, rc 0) 00000100:00100000:2.0:1783562401.980232:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11558:x1870200553163008:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 913us (1156us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1783562401.980240:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:1.0:1783562401.988321:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562401.988588:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163136 00000100:00100000:0.0:1783562401.988609:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163136 00000100:00100000:1.0:1783562401.988765:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:1.0:1783562401.988777:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+6:2364:x1870200553163136:12345-192.168.204.4@tcp:1:lfs.0 00010000:00010000:1.0:1783562401.988842:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.988867:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.988876:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562401.988880:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562401.988884:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.988927:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.988947:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 6 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.988972:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563628544:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562401.989097:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562401.994112:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562401.994174:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163264 00000100:00100000:3.0:1783562401.994184:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163264 00000100:00100000:1.0:1783562401.994200:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6608:1870200563628544:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562401.994232:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1783562401.994711:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bfcf6706d80 x1870200553163264/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:242/0 lens 504/0 e 0 to 0 dl 1783562412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783562401.994726:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6706d80 with x1870200553163264 ext(0->8) 00010000:00010000:3.0:1783562401.994734:0:6554:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 7 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.994750:0:6554:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 7 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562401.994757:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcf6706d80 00000100:00100000:3.0:1783562401.994793:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:3.0:1783562401.994815:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553163264:12345-192.168.204.4@tcp:4:lfs.0 00000100:00100000:3.0:1783562401.995273:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2364:x1870200553163264:12345-192.168.204.4@tcp:4:lfs.0 Request processed in 470us (1170us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783562401.995279:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00002000:00100000:3.0:1783562401.995284:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bfcf6706d80 x1870200553163264/t4294967308(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:242/0 lens 504/448 e 0 to 0 dl 1783562412 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783562401.995294:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf6706d80 with x1870200553163264 ext(0->8) 00010000:00010000:3.0:1783562401.995299:0:6554:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562401.995307:0:6554:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562401.995313:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bfcf6706d80 00000100:00100000:3.0:1783562401.998465:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562401.998598:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163392 00000100:00100000:1.0:1783562401.998611:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163392 00010000:00010000:1.0:1783562401.998653:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562401.998698:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:1.0:1783562401.998707:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553163392:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562401.998723:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783562401.998744:0:5739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783562401.998747:0:5739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783562400 00002000:00010000:1.0:1783562401.998749:0:5739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783562400 00002000:00010000:1.0:1783562401.998751:0:5739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783562400 00010000:00010000:1.0:1783562401.998757:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.998772:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.998796:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022061492/0x4738ba0933b88bb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ca expref: 9 pid: 6547 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.998816:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562401.998821:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562401.998827:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.998859:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562401.998902:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562401.998965:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553163392:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 257us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562401.998972:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00010000:00010000:2.0:1783562401.999056:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999066:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999096:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999105:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999114:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999134:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562401.999139:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999150:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999164:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562401.999173:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69e64a7/0x4738ba0933b88bf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562401.999238:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553163136:12345-192.168.204.4@tcp:1:lfs.0 Request processed in 10463us (10932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562401.999247:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:3.0:1783562402.003002:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.003098:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163648 00000100:00100000:1.0:1783562402.003116:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163648 00000100:00100000:1.0:1783562402.003277:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:1.0:1783562402.003289:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5195050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+43:11558:x1870200553163648:12345-192.168.204.4@tcp:35:lfs.0 00000004:00010000:1.0:1783562402.003372:0:5757:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214df expref: 43 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562402.003772:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1783562402.003821:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1783562402.004162:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1783562402.004216:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.004234:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 47 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.004245:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.004281:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 47 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.004307:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 47 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.004322:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5757:1870200563628672:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562402.004445:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562402.010742:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.010937:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163776 00000100:00100000:0.0:1783562402.010948:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163776 00010000:00010000:0.0:1783562402.010997:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 48 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.011040:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:0.0:1783562402.011057:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:2363:x1870200553163776:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562402.011090:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562402.011098:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 48 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.011112:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 48 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.011137:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562402.011143:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.011154:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.011162:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.011187:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562402.011385:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+48:2363:x1870200553163776:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 333us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.011393:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00010000:00010000:3.0:1783562402.011881:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214bc expref: 47 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562402.011899:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6340a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5757:1870200563628672:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562402.011919:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.011927:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.011932:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783562402.012068:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1783562402.012374:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1783562402.012592:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5757:1870200563628800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783562402.012646:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562402.012682:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00000 going to sleep for 11 seconds 00000100:00100000:0.0:1783562402.012757:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563628800 00000100:00100000:0.0:1783562402.012763:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563628800 00000100:00100000:0.0:1783562402.012818:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783562402.012827:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5757:x1870200563628800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783562402.012894:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5757:x1870200563628800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.012901:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783562402.013011:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562402.013036:0:5757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1783562402.013043:0:5757:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1783562402.013062:0:5757:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf7122680, transno 4294967307 00000100:00100000:3.0:1783562402.013081:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5757:1870200563628800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783562402.013705:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1783562402.013779:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5757:1870200563628928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783562402.013815:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562402.013888:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562402.014520:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563628928 00000100:00100000:1.0:1783562402.014529:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563628928 00000100:00100000:1.0:1783562402.014616:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562402.014627:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5757:x1870200563628928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783562402.014847:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5757:x1870200563628928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 221us (1030us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783562402.014855:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783562402.014941:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef5d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5757:1870200563628928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783562402.015002:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1783562402.015044:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015055:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015062:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015068:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562402.015072:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015081:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015098:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562402.015101:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783562402.015106:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.015112:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88bfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562402.015378:0:5757:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783562402.015615:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1783562402.015627:0:5757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211272223848ns, next at 212272221414ns, rc = 0 00000001:00080000:0.0:1783562402.015634:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1783562402.015667:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfce234ed00) 00010000:00010000:0.0:1783562402.015684:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783562402.015692:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c800/0x4738ba0933b88be5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214df expref: 51 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.015843:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5195050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:11558:x1870200553163648:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 12556us (12855us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1783562402.015853:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00000020:00080000:0.0:1783562402.015857:0:5757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783562402.019503:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562402.019896:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553163904 00000100:00100000:3.0:1783562402.019909:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553163904 00000100:00100000:3.0:1783562402.020027:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 203 00000100:00100000:3.0:1783562402.020038:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+50:11558:x1870200553163904:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562402.020066:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562402.020093:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214e6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.020479:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88c01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214e6 expref: 51 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.020499:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88c01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214e6 expref: 51 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.020551:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562402.020555:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562402.020558:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336800, rc 0) 00000100:00100000:3.0:1783562402.020680:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:11558:x1870200553163904:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 643us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562402.020704:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 203 00000100:00100000:2.0:1783562402.024954:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.025729:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553164160 00000100:00100000:0.0:1783562402.025742:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553164160 00000100:00100000:0.0:1783562402.025806:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:0.0:1783562402.025945:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+51:11558:x1870200553164160:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562402.026556:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:11558:x1870200553164160:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 614us (1611us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1783562402.026565:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:1.0:1783562402.076629:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.077107:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553164288 00000100:00100000:0.0:1783562402.077120:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553164288 00000100:00100000:0.0:1783562402.077193:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:0.0:1783562402.077204:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:11568:x1870200553164288:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:0.0:1783562402.077311:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.077330:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.077343:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.077359:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.077384:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.077392:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077619:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077630:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077639:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562402.077685:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077701:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077715:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077722:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077729:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.077733:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077742:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077757:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562402.077760:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.077767:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077773:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077790:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077796:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077803:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077808:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.077817:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077824:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077832:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234ed00) 00010000:00010000:1.0:1783562402.077835:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.077839:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077844:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077861:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077867:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077873:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077878:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.077880:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077885:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077892:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.077894:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.077904:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.077911:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.078017:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:11568:x1870200553164288:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 813us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.078026:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:1.0:1783562402.104048:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.104166:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553164544 00000100:00100000:2.0:1783562402.104179:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553164544 00000100:00100000:2.0:1783562402.104243:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 205 00000100:00100000:2.0:1783562402.104253:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+52:11571:x1870200553164544:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562402.104275:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562402.104296:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214ed expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104451:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104467:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104480:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104494:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104502:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104510:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104646:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104656:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104664:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562402.104674:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783562402.104782:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104790:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104804:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104811:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562402.104815:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104824:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104836:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562402.104840:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562402.104844:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104850:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104864:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104870:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104877:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104882:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562402.104886:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104902:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104911:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc4c37900) 00010000:00010000:2.0:1783562402.104914:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562402.104917:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104923:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104964:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b88c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 55 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104979:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 54 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.104987:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.104989:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562402.104992:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ca00, rc 0) 00000100:00100000:2.0:1783562402.105070:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:11571:x1870200553164544:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 818us (1031us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783562402.105078:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 205 00000100:00100000:2.0:1783562402.108290:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562402.109044:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553164672 00000100:00100000:3.0:1783562402.109059:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553164672 00000100:00100000:3.0:1783562402.109142:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 206 00000100:00100000:3.0:1783562402.109158:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:11571:x1870200553164672:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562402.109248:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109266:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109279:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109309:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109314:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109319:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109323:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562402.109326:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109331:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109340:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562402.109354:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562402.109358:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.109363:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562402.109464:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:11571:x1870200553164672:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 312us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562402.109472:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 206 00000100:00100000:1.0:1783562402.111849:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.112062:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553164928 00000100:00100000:0.0:1783562402.112072:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553164928 00000100:00100000:0.0:1783562402.112161:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:0.0:1783562402.112172:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+54:11571:x1870200553164928:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562402.112430:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:11571:x1870200553164928:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 259us (590us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783562402.112438:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:1.0:1783562402.174697:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.174882:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553165184 00000100:00100000:2.0:1783562402.174894:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553165184 00000100:00100000:2.0:1783562402.175304:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 207 00000100:00100000:2.0:1783562402.175318:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:11581:x1870200553165184:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562402.175363:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562402.175367:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783562402.175396:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337400/0x4738ba0933b88bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214d1 expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175484:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562402.175491:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562402.175509:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214f4 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175656:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175672:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 55 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175682:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175728:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 55 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.175743:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 55 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.175757:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563629056:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562402.178070:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783562402.181715:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.181751:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6572:1870200563629056:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562402.181789:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.181878:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553165312 00000100:00100000:0.0:1783562402.181889:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553165312 00010000:00010000:0.0:1783562402.181941:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 56 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.181990:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:0.0:1783562402.182003:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+56:2364:x1870200553165312:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562402.182120:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562402.182128:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 56 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182140:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 56 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182191:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214ed expref: 56 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182210:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:0.0:1783562402.182215:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182226:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182234:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.182310:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562402.182399:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:2364:x1870200553165312:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 398us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.182431:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00010000:00010000:1.0:1783562402.183513:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.183528:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562402.183562:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783562402.183844:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88c47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 56 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.183860:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 55 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.183866:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.183880:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562402.183882:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ce00, rc 0) 00000100:00100000:1.0:1783562402.183946:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:11581:x1870200553165184:12345-192.168.204.4@tcp:101:bash.0 Request processed in 8632us (9264us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783562402.183956:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 207 00000100:00100000:2.0:1783562402.187356:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.187461:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553165568 00000100:00100000:0.0:1783562402.187472:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553165568 00000100:00100000:0.0:1783562402.187543:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 208 00000100:00100000:0.0:1783562402.187555:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+55:11581:x1870200553165568:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:0.0:1783562402.187935:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.187960:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.187973:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562402.188057:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1783562402.188085:0:5754:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a1d5ff9 reply state 00000000a52a817e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.188095:0:5754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562402.188874:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:11581:x1870200553165568:12345-192.168.204.4@tcp:36:bash.0 Request processed in 945us (1158us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783562402.188886:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 208 00000020:00080000:0.0:1783562402.188893:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783562402.194276:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194299:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194308:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194315:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562402.194321:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194331:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194353:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.194356:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562402.194362:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.194370:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.196787:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562402.197028:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553165696 00000100:00100000:3.0:1783562402.197043:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553165696 00000100:00100000:3.0:1783562402.197140:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 209 00000100:00100000:3.0:1783562402.197153:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:11581:x1870200553165696:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562402.197255:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562402.197293:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c214fb expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.197433:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.197455:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 58 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.197467:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.197938:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 58 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.197990:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 58 pid: 6572 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562402.198007:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcd914c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629184:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562402.198377:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562402.202029:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcd914c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629184:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562402.202099:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.203042:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.204368:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553165824 00000100:00100000:1.0:1783562402.204384:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553165824 00010000:00010000:1.0:1783562402.204493:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 59 pid: 6572 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.204808:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:1.0:1783562402.204819:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:2364:x1870200553165824:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562402.204837:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562402.204846:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 59 pid: 6572 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204859:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 59 pid: 6572 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204886:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b88c4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214f4 expref: 59 pid: 6572 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204906:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.204910:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204923:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204952:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.204985:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562402.205035:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.205047:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.205067:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:2364:x1870200553165824:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 249us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.205076:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000004:00200000:3.0:1783562402.205316:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783562402.205321:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562402.205346:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.205488:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88c63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.205516:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.205524:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562402.205527:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562402.205530:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336600, rc 0) 00000100:00100000:3.0:1783562402.205599:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:11581:x1870200553165696:12345-192.168.204.4@tcp:101:bash.0 Request processed in 8449us (8831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562402.205617:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 209 00000100:00100000:2.0:1783562402.210244:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.210471:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166080 00000100:00100000:0.0:1783562402.210488:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166080 00000100:00100000:0.0:1783562402.210578:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:0.0:1783562402.210594:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+57:11581:x1870200553166080:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:0.0:1783562402.211028:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:11581:x1870200553166080:12345-192.168.204.4@tcp:35:bash.0 Request processed in 438us (808us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783562402.211037:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:1.0:1783562402.260151:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.260309:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166208 00000100:00100000:2.0:1783562402.260323:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166208 00000100:00100000:2.0:1783562402.260542:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 210 00000100:00100000:2.0:1783562402.260558:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+58:11587:x1870200553166208:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562402.260607:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562402.260650:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21502 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260749:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260768:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260782:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562402.260863:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783562402.260867:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562402.260890:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260919:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21502 expref: 60 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260942:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21502 expref: 59 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.260952:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:2.0:1783562402.260956:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562402.260981:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d200, rc 0) 00000100:00100000:2.0:1783562402.261129:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553166208:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 576us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.261138:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 210 00000100:00100000:2.0:1783562402.263920:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.264801:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166336 00000100:00100000:0.0:1783562402.264823:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166336 00000100:00100000:0.0:1783562402.264936:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 211 00000100:00100000:0.0:1783562402.264954:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553166336:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562402.264995:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562402.265030:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21509 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265139:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265194:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265212:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265232:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265240:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265247:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265441:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265451:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265459:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562402.265527:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783562402.265543:0:5754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562402.265574:0:5754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265591:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265616:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265623:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265632:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265639:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562402.265644:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265653:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265671:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:0.0:1783562402.265675:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562402.265680:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265688:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9e00/0x4738ba0933b88c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265708:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265716:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265722:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265735:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562402.265738:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265744:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265753:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562402.265755:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562402.265758:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265763:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265812:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9800/0x4738ba0933b88c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 61 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265828:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 60 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.265835:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:0.0:1783562402.265838:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562402.265840:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562402.265961:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11587:x1870200553166336:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1010us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.265971:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 211 00000100:00100000:0.0:1783562402.272171:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.272349:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.272487:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166720 00000100:00100000:2.0:1783562402.272511:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166720 00000100:00100000:2.0:1783562402.272632:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 212 00000100:00100000:2.0:1783562402.272648:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11587:x1870200553166720:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562402.272689:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562402.272733:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21510 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.272951:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.272972:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.272982:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 61 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.272992:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.273043:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 61 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.273063:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 61 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.273098:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefafdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629312:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562402.273289:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.273302:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.273314:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefaffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629440:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562402.273352:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3b840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562402.273648:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166464 00000100:00100000:3.0:1783562402.273659:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166464 00010000:00010000:3.0:1783562402.273871:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 62 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562402.273922:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:3.0:1783562402.273932:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:2364:x1870200553166464:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562402.273951:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562402.273960:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 62 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.273974:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 62 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.274002:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562402.274008:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.274018:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.274026:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562402.274091:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:2364:x1870200553166464:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 158us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562402.274099:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:0.0:1783562402.280344:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1783562402.280568:0:5755:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.4@tcp) returned -22 from blocking AST (req@00000000c17a3161 x1870200563629312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 61 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.280571:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553166848 00000100:00100000:1.0:1783562402.280585:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553166848 00010000:00010000:2.0:1783562402.280608:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8800/0x4738ba0933b88c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21509 expref: 62 pid: 5754 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.280638:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefafdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629312:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562402.280657:0:11471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.280659:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefaffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5755:1870200563629440:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562402.280702:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.280712:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.280720:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00010000:00010000:2.0:1783562402.280727:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.280737:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:2363:x1870200553166848:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.280778:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280778:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562402.280788:0:11471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280807:0:11471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280837:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336600/0x4738ba0933b88c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214fb expref: 61 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280852:0:11471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.280856:0:11471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280874:0:11471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280883:0:11471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.280915:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562402.280938:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.280949:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562402.280981:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:1.0:1783562402.281031:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:2363:x1870200553166848:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 289us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.281042:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00010000:00010000:2.0:1783562402.281275:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d000/0x4738ba0933b88c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.281297:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 60 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.281306:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.281310:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562402.281313:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d600, rc 0) 00000100:00100000:2.0:1783562402.281349:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11587:x1870200553166720:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 8705us (8999us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783562402.281372:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 212 00000100:00100000:1.0:1783562402.285644:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.285706:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167104 00000100:00100000:2.0:1783562402.285725:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167104 00000100:00100000:2.0:1783562402.285842:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562402.285859:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11587:x1870200553167104:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:2.0:1783562402.285890:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.285959:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b88c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214e6 expref: 60 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.285987:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.285994:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562402.286175:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553167104:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 320us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.286183:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562402.289622:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.289787:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167232 00000100:00100000:1.0:1783562402.289803:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167232 00000100:00100000:1.0:1783562402.289881:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 213 00000100:00100000:1.0:1783562402.289897:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefaffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553167232:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:1.0:1783562402.290024:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.290041:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.290107:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562402.290322:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783562402.290471:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefaffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553167232:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 577us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.290482:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 213 00000100:00100000:0.0:1783562402.293697:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.293920:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167360 00000100:00100000:1.0:1783562402.294040:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167360 00000100:00100000:1.0:1783562402.294094:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 214 00000100:00100000:1.0:1783562402.294102:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+59:11587:x1870200553167360:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562402.294124:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.294146:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21517 expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294238:0:12218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294247:0:12218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 60 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294276:0:12218:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294289:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 60 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294307:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.294309:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562402.294312:0:12218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 60 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.294317:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682a00, rc 0) 00000100:00100000:1.0:1783562402.294506:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11587:x1870200553167360:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 404us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.294511:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 214 00000040:00080000:2.0:1783562402.422893:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562402.422907:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562402.422950:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783562402.422956:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783562402.423131:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefafdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563629568:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562402.423286:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562402.431682:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefafdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563629568:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783562402.432059:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.432180:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167488 00000100:00100000:0.0:1783562402.432193:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167488 00000100:00100000:0.0:1783562402.432289:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 215 00000100:00100000:0.0:1783562402.432301:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11588:x1870200553167488:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562402.432347:0:5755:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783562402.432613:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11588:x1870200553167488:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 312us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.432622:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 215 00000100:00100000:0.0:1783562402.436766:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.436952:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167616 00000100:00100000:1.0:1783562402.436969:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167616 00000100:00100000:1.0:1783562402.437158:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 216 00000100:00100000:1.0:1783562402.437173:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11588:x1870200553167616:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.437611:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437636:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437654:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437675:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437684:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437692:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437795:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437805:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.437813:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562402.437878:0:6572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783562402.437908:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562402.437930:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438016:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438035:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438043:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438051:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.438059:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438068:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438085:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:1.0:1783562402.438088:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.438094:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438101:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b88cbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438119:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438126:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438143:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438149:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.438153:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438160:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438171:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bfcc9774000) 00010000:00010000:1.0:1783562402.438173:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.438176:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438182:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88cc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438201:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438209:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438215:0:6572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438221:0:6572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.438224:0:6572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438242:0:6572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438250:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.438267:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.438271:0:6572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.438277:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.438498:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11588:x1870200553167616:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 1322us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.438510:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 216 00000100:00100000:3.0:1783562402.441624:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.441678:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553167872 00000100:00100000:1.0:1783562402.441693:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553167872 00000100:00100000:1.0:1783562402.441765:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:1.0:1783562402.441778:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+60:11588:x1870200553167872:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.441810:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.442128:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88cd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2151e expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442280:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442498:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442526:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562402.442683:0:12218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783562402.442848:0:12218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442858:0:12218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442866:0:12218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442874:0:12218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.442880:0:12218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442887:0:12218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442904:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.442908:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562402.442913:0:12218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442920:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442975:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88cd3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2151e expref: 62 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.442987:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:1.0:1783562402.442989:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562402.443000:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88cd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2151e expref: 62 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.443011:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683000, rc 0) 00000100:00100000:1.0:1783562402.443100:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553167872:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1324us (1493us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1783562402.443109:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:3.0:1783562402.446542:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.446613:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553168000 00000100:00100000:1.0:1783562402.446625:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553168000 00000100:00100000:1.0:1783562402.446686:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:1.0:1783562402.446695:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd914c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553168000:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783562402.446739:0:5754:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783562402.446909:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd914c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553168000:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 213us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.446918:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:0.0:1783562402.451839:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.451994:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553168256 00000100:00100000:1.0:1783562402.452006:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553168256 00000100:00100000:1.0:1783562402.452106:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:1.0:1783562402.452117:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553168256:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.452142:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.452145:0:6572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783562402.452180:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b88c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21502 expref: 61 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.452204:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562402.452209:0:6572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562402.452228:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88ce8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21525 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783562402.452860:0:6572:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1783562402.453078:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.453092:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.453104:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.453155:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683000/0x4738ba0933b88ce8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21525 expref: 63 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.453173:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21525 expref: 62 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.453181:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562402.453184:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562402.453187:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682200, rc 0) 00000100:00100000:1.0:1783562402.453268:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:11588:x1870200553168256:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1440us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783562402.453277:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:3.0:1783562402.458854:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.458959:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553168512 00000100:00100000:1.0:1783562402.458981:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553168512 00000100:00100000:1.0:1783562402.459211:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:1.0:1783562402.459227:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:11588:x1870200553168512:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.459362:0:12218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562402.459450:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b88cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21525 expref: 62 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459479:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfcc9774000) 00010000:00010000:1.0:1783562402.459494:0:12218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562402.459522:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459547:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459560:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459576:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459584:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459590:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459681:0:12218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459689:0:12218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459696:0:12218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459776:0:12218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.459788:0:12218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459798:0:12218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459808:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562402.459811:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.459815:0:12218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459822:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88cfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459832:0:12218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459839:0:12218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459844:0:12218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459849:0:12218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.459853:0:12218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459860:0:12218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459868:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf30cd454 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562402.459870:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.459880:0:12218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.459886:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf30cd454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.460187:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553168512:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 962us (1362us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562402.460196:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:1.0:1783562402.463442:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.463549:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553168640 00000100:00100000:0.0:1783562402.463564:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553168640 00000100:00100000:0.0:1783562402.463639:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 221 00000100:00100000:0.0:1783562402.463650:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+61:11588:x1870200553168640:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562402.463679:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562402.463854:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2152c expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.463919:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.464108:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.464124:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.464268:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8200/0x4738ba0933b88d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 63 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.464291:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 62 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.464299:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562402.464302:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783562402.464306:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9400, rc 0) 00000100:00100000:0.0:1783562402.464392:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:11588:x1870200553168640:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 744us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.464399:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 221 00000100:00100000:0.0:1783562402.470375:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.470577:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553168896 00000100:00100000:1.0:1783562402.470594:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553168896 00000100:00100000:1.0:1783562402.470677:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 222 00000100:00100000:1.0:1783562402.470695:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+62:11588:x1870200553168896:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.470829:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.470856:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.470870:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562402.471399:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1783562402.471620:0:6572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce9d55d6 reply state 000000002c89afe2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.471634:0:6572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562402.471800:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+64:11588:x1870200553168896:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1104us (1440us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1783562402.471810:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 222 00010000:00010000:0.0:1783562402.473776:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473801:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473811:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473818:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562402.473824:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473834:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473879:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:0.0:1783562402.473883:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783562402.473889:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.473897:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682000/0x4738ba0933b88d19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.474596:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.475023:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169024 00000100:00100000:1.0:1783562402.475037:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169024 00000100:00100000:1.0:1783562402.475133:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00100000:1.0:1783562402.475145:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+63:11588:x1870200553169024:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.475177:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.475202:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21533 expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.475280:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 64 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.475295:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 64 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.475315:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562402.475318:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562402.475321:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683e00, rc 0) 00000100:00100000:1.0:1783562402.475393:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+64:11588:x1870200553169024:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 251us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.475435:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00100000:3.0:1783562402.480867:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.481357:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169152 00000100:00100000:0.0:1783562402.481375:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169152 00000100:00100000:0.0:1783562402.481523:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:0.0:1783562402.481550:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2361:x1870200553169152:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783562402.481577:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562402.482086:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2361:x1870200553169152:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 538us (1238us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783562402.482096:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:2.0:1783562402.488353:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.488465:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169408 00000100:00100000:0.0:1783562402.488482:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169408 00000100:00100000:0.0:1783562402.488583:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:0.0:1783562402.488602:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+64:11588:x1870200553169408:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562402.489024:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+65:11588:x1870200553169408:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 425us (692us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783562402.489034:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:2.0:1783562402.495974:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.496125:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169664 00000100:00100000:0.0:1783562402.496141:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169664 00000100:00100000:1.0:1783562402.496605:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 224 00000100:00100000:1.0:1783562402.496625:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+65:11588:x1870200553169664:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783562402.496804:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+65:11588:x1870200553169664:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 185us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.496813:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 224 00000100:00100000:1.0:1783562402.501754:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.502606:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169792 00000100:00100000:2.0:1783562402.502626:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169792 00000100:00100000:2.0:1783562402.502719:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:2.0:1783562402.502735:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+65:11588:x1870200553169792:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562402.502778:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562402.502808:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2153a expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.502925:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.502956:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.502972:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562402.503024:0:6572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562402.503047:0:6572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.503081:0:6572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b88d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2153a expref: 67 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.503100:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2153a expref: 66 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.503107:0:6572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:2.0:1783562402.503110:0:6572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783562402.503113:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ca00, rc 0) 00000100:00100000:2.0:1783562402.503191:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+66:11588:x1870200553169792:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 461us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.503196:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:2.0:1783562402.509522:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.509666:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553169920 00000100:00100000:1.0:1783562402.509686:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553169920 00000100:00100000:1.0:1783562402.509792:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:1.0:1783562402.509806:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+10:2364:x1870200553169920:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.509844:0:6549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.509892:0:6549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21541 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562402.509950:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f00a1, blocks: 0x1 00010000:00010000:1.0:1783562402.509986:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=211s v=(0 0) 00010000:00010000:1.0:1783562402.509992:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562402.510006:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 11 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.510038:0:6549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 11 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.510060:0:6549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683000, rc 0) 00000100:00100000:1.0:1783562402.510161:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:2364:x1870200553169920:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 357us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.510172:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:0.0:1783562402.515310:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.516576:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170176 00000100:00100000:2.0:1783562402.516598:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170176 00000100:00100000:2.0:1783562402.516686:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 226 00000100:00100000:2.0:1783562402.516699:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+66:11588:x1870200553170176:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783562402.516856:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+66:11588:x1870200553170176:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 159us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.516876:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 226 00000100:00100000:3.0:1783562402.522131:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.522263:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170304 00000100:00100000:0.0:1783562402.522282:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170304 00000100:00100000:0.0:1783562402.522376:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:0.0:1783562402.522391:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:11588:x1870200553170304:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562402.522443:0:6550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562402.522472:0:6550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21548 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.522519:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.522538:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562402.522544:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562402.522549:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 12 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.522590:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.522605:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.522623:0:6550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6550:1870200563629696:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562402.522949:0:6550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562402.527466:0:6550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6550:1870200563629696:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562402.527522:0:6550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 12 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.527600:0:6550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8200, rc 0) 00000100:00100000:0.0:1783562402.527833:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:11588:x1870200553170304:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 5443us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.527844:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:3.0:1783562402.529375:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.529576:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170432 00000100:00100000:2.0:1783562402.529590:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170432 00010000:00010000:2.0:1783562402.529787:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.529848:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:2.0:1783562402.529860:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2364:x1870200553170432:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.529883:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.529918:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.529935:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.529967:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000391e7a0c/0x4738ba0933b88d35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21541 expref: 12 pid: 6549 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.529991:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562402.529996:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562402.530005:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 11 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.530017:0:7447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 11 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.530100:0:7447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 11 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.530118:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefafe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7447:1870200563629824:192.168.204.4@tcp:105: 00000100:00100000:2.0:1783562402.530237:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc2a3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562402.535984:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefafe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7447:1870200563629824:192.168.204.4@tcp:105: 00010000:00010000:0.0:1783562402.536034:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562402.536144:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:2364:x1870200553170432:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 6284us (6776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.536162:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:1.0:1783562402.536457:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.536653:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170560 00000100:00100000:2.0:1783562402.536664:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170560 00002000:00100000:2.0:1783562402.536744:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bfcef9adc00 x1870200553170560/t0(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:243/0 lens 504/0 e 0 to 0 dl 1783562413 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562402.536758:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef9adc00 with x1870200553170560 ext(0->12) 00002000:00010000:2.0:1783562402.536765:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef9adc00 00000100:00100000:2.0:1783562402.536841:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:2.0:1783562402.536853:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+11:2364:x1870200553170560:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783562402.537614:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:2364:x1870200553170560:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 757us (1153us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1783562402.537626:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00002000:00100000:2.0:1783562402.537635:0:6553:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bfcef9adc00 x1870200553170560/t4294967321(0) o4->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:243/0 lens 504/448 e 0 to 0 dl 1783562413 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562402.537645:0:6553:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef9adc00 with x1870200553170560 ext(0->12) 00002000:00010000:2.0:1783562402.537650:0:6553:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef9adc00 00000100:00100000:1.0:1783562402.541525:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.542054:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170688 00000100:00100000:0.0:1783562402.542074:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170688 00000100:00100000:0.0:1783562402.542183:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:0.0:1783562402.542211:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+66:11588:x1870200553170688:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783562402.585966:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1783562402.586010:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1783562402.586594:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563629952:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783562402.586717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783562402.586868:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1783562402.586953:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc52a20c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783562402.586979:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcc5c89c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc52a2600 00000020:00080000:1.0:1783562402.586982:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcc5c89700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcd0f3e800 00000020:00080000:1.0:1783562402.587007:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfd00e00000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783562402.587010:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfd00deda00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfd00e009c0 00000020:00080000:1.0:1783562402.587013:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcc513af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef9c7400 00000020:00080000:1.0:1783562402.587050:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783562402.587299:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783562402.587509:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563629952 00000100:00100000:2.0:1783562402.587524:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563629952 00000100:00100000:0.0:1783562402.587770:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563630080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783562402.587804:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783562402.587824:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563629952:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783562402.587856:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1783562402.587860:0:6549:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1783562402.587915:0:6549:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4f00a0, atime: 0x6a4f00a0, ctime: 0x6a4f00a0, blocks: 0x1 00010000:00010000:2.0:1783562402.587927:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.587938:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563630080 00000100:00100000:0.0:1783562402.587953:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563630080 00010000:00010000:2.0:1783562402.587960:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=211s v=(0 0) 00010000:00010000:2.0:1783562402.587968:0:6549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562402.587976:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.587995:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.588007:0:6549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.588018:0:6549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.588029:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783562402.588046:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563630080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783562402.588077:0:6547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1783562402.588093:0:6549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562402.588109:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.588136:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.588162:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783562402.588167:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562402.588172:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.588202:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.588218:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 12 pid: 6608 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.588230:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcc3ebbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563630208:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562402.588628:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66903c0 going to sleep for 11 seconds 00000100:00080000:0.0:1783562402.588650:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562402.588877:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11588:x1870200553170688:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 46666us (47660us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.588890:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:2.0:1783562402.589067:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563629952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1245us (2349us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783562402.589078:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1783562402.589111:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562402.589120:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.589145:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562402.589151:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.589162:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.589187:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.589194:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e352c24a/0x4738ba0933b88d43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.589227:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562402.589229:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562402.589231:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783562402.589519:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcefafca80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783562402.589538:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563629952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783562402.595236:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcc3ebbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563630208:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562402.595272:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.595345:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.595755:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170816 00000100:00100000:2.0:1783562402.595769:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170816 00010000:00010000:2.0:1783562402.595834:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 13 pid: 6608 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.595906:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:2.0:1783562402.595919:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+13:2363:x1870200553170816:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.595938:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.595945:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 13 pid: 6608 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.595992:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 13 pid: 6608 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.596034:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b88b05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c214a7 expref: 13 pid: 6608 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.596056:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562402.596062:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562402.596069:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.596082:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.596117:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562402.596160:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.596177:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.596202:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2363:x1870200553170816:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 283us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.596213:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00010000:00010000:0.0:1783562402.596234:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562402.596244:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.596317:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562402.596328:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.596338:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562402.596345:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.596356:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.596701:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.596732:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562402.596734:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562402.596736:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562402.596982:0:6547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562402.596993:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b88d4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.599179:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.599264:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553170944 00000100:00100000:1.0:1783562402.599289:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553170944 00000100:00100000:1.0:1783562402.599379:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:1.0:1783562402.599398:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+12:2364:x1870200553170944:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783562402.600082:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563630080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12026us (12215us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1783562402.600099:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783562402.600366:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1783562402.600373:0:3272:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1783562402.600534:0:3272:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfcf7122680 x1870200563630080/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783562418 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783562402.600552:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf7122680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783562402.600605:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563630080:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1783562402.631854:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1783562402.631883:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1783562402.631893:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1783562402.631978:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553170944:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 32577us (32802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562402.632078:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562402.634762:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.634912:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171200 00000100:00100000:1.0:1783562402.634927:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171200 00000100:00100000:1.0:1783562402.635012:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 228 00000100:00100000:1.0:1783562402.635025:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11588:x1870200553171200:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.635197:0:12218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562402.635243:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ca00/0x4738ba0933b88d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2153a expref: 20 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.635271:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562402.635341:0:12218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562402.635400:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.635484:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.635499:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562402.635960:0:12218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df676c6b reply state 0000000081f868dd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.635974:0:12218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562402.636168:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:11588:x1870200553171200:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1145us (1419us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783562402.636177:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 228 00010000:00010000:2.0:1783562402.639373:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.639397:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.639437:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.639437:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1783562402.639463:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562402.639470:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.639480:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.639491:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171328 00000100:00100000:1.0:1783562402.639504:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171328 00010000:00010000:2.0:1783562402.639507:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:2.0:1783562402.639511:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562402.639517:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.639523:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88d51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.639598:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:1.0:1783562402.639613:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553171328:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783562402.640014:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783562402.640017:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783562400 00002000:00010000:1.0:1783562402.640019:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783562400 00002000:00010000:1.0:1783562402.640021:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783562401 -> 1783562400 00002000:00010000:1.0:1783562402.640023:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783562402.640090:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553171328:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 480us (685us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783562402.640095:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:2.0:1783562402.641734:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.641834:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171584 00000100:00100000:1.0:1783562402.641843:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171584 00000100:00100000:1.0:1783562402.641910:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:1.0:1783562402.641919:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:11588:x1870200553171584:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.642014:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.642059:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.642070:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.642112:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.642128:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 20 pid: 5756 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.642146:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563630336:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562402.642262:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562402.644760:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.644799:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563630336:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562402.644906:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171712 00000100:00100000:2.0:1783562402.644916:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171712 00010000:00010000:1.0:1783562402.645017:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645143:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 21 pid: 5756 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.645184:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:2.0:1783562402.645196:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2363:x1870200553171712:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.645217:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.645225:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 21 pid: 5756 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645237:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 21 pid: 5756 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645282:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9400/0x4738ba0933b88d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2152c expref: 21 pid: 5756 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645302:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:2.0:1783562402.645307:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645319:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645327:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.645459:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562402.645535:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:2363:x1870200553171712:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 333us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.645544:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 85 00010000:00010000:1.0:1783562402.645738:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645746:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645782:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645788:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645803:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645810:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.645881:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645893:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645903:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:1.0:1783562402.645906:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783562402.645910:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.645917:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.646035:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:11588:x1870200553171584:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 4115us (4309us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783562402.646045:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:0.0:1783562402.649301:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.649562:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171840 00000100:00100000:1.0:1783562402.649578:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171840 00000100:00100000:1.0:1783562402.649721:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:1.0:1783562402.649734:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2364:x1870200553171840:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.649798:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.649836:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 8 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.649866:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562402.649871:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562402.649877:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.649925:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 8 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.649940:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 8 pid: 6550 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.649969:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563630464:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562402.650074:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562402.652227:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6547:1870200563630464:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562402.652264:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.652899:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.652994:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553171968 00000100:00100000:2.0:1783562402.653002:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553171968 00010000:00010000:2.0:1783562402.653049:0:7447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 9 pid: 6550 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.653096:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:2.0:1783562402.653109:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+9:2363:x1870200553171968:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.653127:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.653161:0:7447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 9 pid: 6550 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.653197:0:7447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 9 pid: 6550 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.653228:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b88d3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21548 expref: 9 pid: 6550 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.653247:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562402.653251:0:7447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783562402.653258:0:7447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.653269:0:7447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.653305:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562402.653344:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653354:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.653382:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553171968:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 274us (483us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562402.653385:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.653392:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00010000:00010000:1.0:1783562402.653428:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653436:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653442:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562402.653447:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653457:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653472:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.653480:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000673bf288/0x4738ba0933b88d5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.653651:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2364:x1870200553171840:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 3920us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.653658:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:0.0:1783562402.656724:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.656793:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553172224 00000100:00100000:1.0:1783562402.656808:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553172224 00000100:00100000:1.0:1783562402.656892:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 230 00000100:00100000:1.0:1783562402.656926:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:11588:x1870200553172224:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783562402.657049:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657071:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657086:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657433:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657443:0:5754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 20 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657460:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657505:0:5754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 20 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.657537:0:5754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 20 pid: 12218 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.657557:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563630592:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562402.657705:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562402.659888:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.659991:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553172352 00000100:00100000:2.0:1783562402.660007:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553172352 00000100:00100000:1.0:1783562402.660054:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563630592:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562402.660071:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 21 pid: 12218 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.660091:0:5754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.660137:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:2.0:1783562402.660150:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2363:x1870200553172352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.660185:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.660194:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 21 pid: 12218 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660210:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 21 pid: 12218 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660244:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b88d20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21533 expref: 21 pid: 12218 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660265:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:2.0:1783562402.660270:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660283:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660290:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.660325:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562402.660343:0:5754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.660353:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.660422:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:2363:x1870200553172352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 251us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.660432:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000001:00080000:1.0:1783562402.660804:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1783562402.660969:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1783562402.661028:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1783562402.661130:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563630720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783562402.661211:0:5754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562402.661331:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562402.661373:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563630720 00000100:00100000:3.0:1783562402.661379:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563630720 00000100:00100000:2.0:1783562402.661638:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783562402.661647:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563630720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783562402.661727:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563630720:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562402.661740:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783562402.661799:0:5754:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1783562402.661806:0:5754:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf7122680, transno 4294967322 00000100:00100000:3.0:1783562402.661823:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563630720:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1783562402.662340:0:5754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1783562402.662395:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563630848:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783562402.662470:0:5754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562402.662494:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783562402.662495:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563630848 00000100:00100000:1.0:1783562402.662501:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563630848 00000100:00100000:1.0:1783562402.662550:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783562402.662559:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5754:x1870200563630848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783562402.662744:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5754:x1870200563630848:12345-0@lo:1000:mdt00_000.0 Request processed in 185us (273us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1783562402.662752:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783562402.662828:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5754:1870200563630848:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783562402.662866:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662878:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662886:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662894:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562402.662901:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662916:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662934:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfce234eb00) 00010000:00010000:3.0:1783562402.662938:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562402.662945:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662952:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b88d6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.662995:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663008:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663014:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663020:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562402.663023:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663030:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663039:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562402.663042:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562402.663050:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 23 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663065:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 23 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663075:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 23 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.663103:0:5754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 23 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562402.663115:0:5754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563630976:192.168.204.4@tcp:105: 00000100:00100000:3.0:1783562402.663196:0:5754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc6690b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562402.666095:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.666110:0:5754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5754:1870200563630976:192.168.204.4@tcp:105: 00010000:00010000:1.0:1783562402.666160:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.666169:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553172480 00010000:00010000:1.0:1783562402.666171:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88cb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.666177:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553172480 00010000:00010000:1.0:1783562402.666210:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666269:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666282:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.666287:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00010000:00010000:1.0:1783562402.666295:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.666299:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11587:x1870200553172480:12345-192.168.204.4@tcp:49:lfs.0 00010000:00010000:1.0:1783562402.666302:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666309:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666315:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.666319:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666328:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666342:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.666344:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.666347:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666353:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666363:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666375:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666381:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666385:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.666388:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666394:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666427:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.666430:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783562402.666433:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.666439:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562402.666546:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+24:11587:x1870200553172480:12345-192.168.204.4@tcp:49:lfs.0 Request processed in 248us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562402.666560:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:1.0:1783562402.666785:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11588:x1870200553172224:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 9863us (10074us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1783562402.666795:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 230 00000020:00080000:1.0:1783562402.666799:0:5754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783562402.666896:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562402.666902:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562402.667319:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783562402.667326:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562402.668953:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.669059:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553172736 00000100:00100000:1.0:1783562402.669070:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553172736 00000100:00100000:1.0:1783562402.669131:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:1.0:1783562402.669144:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11587:x1870200553172736:12345-192.168.204.4@tcp:58:lfs.0 00000040:00080000:1.0:1783562402.669826:0:12218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783562402.670012:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11587:x1870200553172736:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 868us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.670024:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:2.0:1783562402.670038:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562402.670076:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553172992 00000100:00100000:3.0:1783562402.670083:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553172992 00000100:00100000:3.0:1783562402.670121:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:3.0:1783562402.670130:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5197050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+23:11588:x1870200553172992:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783562402.670812:0:5757:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783562402.670906:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1783562402.670961:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.670983:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.671000:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.671013:0:5757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.671022:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.671028:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562402.671059:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783562402.671171:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5197050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11588:x1870200553172992:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1039us (1130us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1783562402.671191:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000020:00080000:3.0:1783562402.671197:0:5757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562402.671224:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562402.671232:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.671240:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562402.671244:0:8323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.671253:0:8323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.671268:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bfcc89eaf00) 00010000:00010000:1.0:1783562402.671271:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783562402.671278:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.671284:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337200/0x4738ba0933b88d7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.671307:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562402.671309:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562402.671311:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562402.696101:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562402.696310:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553173120 00000100:00100000:1.0:1783562402.696327:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553173120 00000100:00100000:1.0:1783562402.696443:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 232 00000100:00100000:1.0:1783562402.696461:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+25:11590:x1870200553173120:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562402.696540:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562402.696571:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2154f expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696666:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696687:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696703:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696722:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696730:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.696737:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.697191:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.697203:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 26 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.697213:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.697269:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 26 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.697293:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 26 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562402.697309:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563631104:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562402.697479:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfceef37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562402.700551:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5756:1870200563631104:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562402.700603:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.702089:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562402.702731:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553173376 00000100:00100000:0.0:1783562402.702746:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553173376 00000100:00100000:0.0:1783562402.702943:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:0.0:1783562402.702959:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:9216:x1870200553173376:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783562402.703393:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:9216:x1870200553173376:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 435us (1314us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1783562402.703466:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:0.0:1783562402.711199:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562402.711344:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553173504 00000100:00100000:2.0:1783562402.711359:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553173504 00010000:00010000:2.0:1783562402.711443:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 28 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.711498:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:2.0:1783562402.711509:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:2363:x1870200553173504:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562402.711538:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562402.711547:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 28 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711562:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 28 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711639:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d600/0x4738ba0933b88ca2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21510 expref: 28 pid: 5755 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711655:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:2.0:1783562402.711659:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711669:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711698:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562402.711737:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562402.711828:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+27:2363:x1870200553173504:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 319us (650us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562402.711831:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562402.711837:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00010000:00010000:1.0:1783562402.711841:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562402.711911:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783562402.711916:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562402.711946:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.711963:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.711975:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.711983:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712018:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712025:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.712031:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712040:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712052:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562402.712055:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.712059:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712065:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712078:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712085:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712091:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712097:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562402.712100:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712120:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712129:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562402.712131:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562402.712135:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712141:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682600/0x4738ba0933b88d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712184:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b88d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2154f expref: 27 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712199:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2154f expref: 26 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562402.712207:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562402.712209:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562402.712211:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683a00, rc 0) 00000100:00100000:1.0:1783562402.712241:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11590:x1870200553173120:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 15789us (16161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562402.712250:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 232 00010000:00010000:2.0:1783562402.742619:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562403.191122:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562403.191160:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563631360:0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.191160:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563631616:0@lo:400:kworker.0 00000100:00100000:2.0:1783562403.191245:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563631744:0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.191363:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562403.191478:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.191528:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562403.191582:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563631488:0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.191618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562403.191670:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631488 00000100:00100000:0.0:1783562403.191683:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631488 00000100:00100000:1.0:1783562403.191763:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562403.191791:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563631872:0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.191819:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562403.191897:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631360 00000100:00100000:0.0:1783562403.191902:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631360 00000100:00100000:0.0:1783562403.191936:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783562403.191951:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563631488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.192025:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563631488:12345-0@lo:400:kworker.0 Request processed in 76us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562403.192045:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783562403.192070:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783562403.192076:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.192113:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563631360:12345-0@lo:400:kworker.0 Request processed in 37us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562403.192120:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1783562403.192139:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562403.192161:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631616 00000100:00100000:1.0:1783562403.192167:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631616 00000100:00100000:0.0:1783562403.192185:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563631488:0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.192206:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631872 00000100:00100000:1.0:1783562403.192211:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631872 00000100:00100000:0.0:1783562403.192237:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783562403.192245:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783562403.192249:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563631616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.192259:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563631872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.192293:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563631616:12345-0@lo:400:kworker.0 Request processed in 48us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562403.192301:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783562403.192330:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563631616:0@lo:400:kworker.0 00000100:00100000:0.0:1783562403.192363:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563631360:0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.192378:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563631872:12345-0@lo:400:kworker.0 Request processed in 123us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562403.192384:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563631872:0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.192469:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783562403.192690:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562403.192730:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631744 00000100:00100000:1.0:1783562403.192735:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631744 00000100:00100000:2.0:1783562403.192742:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563631232 00000100:00100000:2.0:1783562403.192748:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563631232 00000100:00100000:1.0:1783562403.192784:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783562403.192792:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783562403.192796:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563631744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562403.192806:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563631232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562403.192851:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563631744:12345-0@lo:400:kworker.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562403.192859:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563631232:12345-0@lo:400:kworker.0 Request processed in 57us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562403.192860:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783562403.192871:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1783562403.192882:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562403.192915:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563631744:0@lo:400:kworker.0 00000100:00100000:2.0:1783562403.192933:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563631232:0@lo:400:kworker.0 00000040:00080000:0.0:1783562403.258566:0:12368:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562403.258578:0:12368:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562403.258627:0:12368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783562403.258633:0:12368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783562403.702761:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563632000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562403.702851:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783562403.703026:0:7881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212959621748ns, next at 213959618978ns, rc = 0 00000100:00100000:1.0:1783562403.703051:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562403.703068:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562403.703105:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562403.703175:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632000 00000100:00100000:1.0:1783562403.703184:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632000 00000100:00100000:1.0:1783562403.703242:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632128 00000100:00100000:1.0:1783562403.703246:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632128 00000100:00100000:1.0:1783562403.703273:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783562403.703284:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563632000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783562403.703323:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562403.703435:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563632000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562403.703445:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783562403.703471:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783562403.703480:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783562403.703493:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3855613952 00000100:00100000:1.0:1783562403.703550:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562403.703559:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783562403.703630:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562403.703902:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563632000:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783562403.706810:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783562403.706824:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562403.706869:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783562403.706882:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783562403.707048:0:11488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefaff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563632256:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562403.707160:0:11488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562403.710946:0:11488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefaff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11488:1870200563632256:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562403.713974:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562403.714452:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553173632 00000100:00100000:1.0:1783562403.714465:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553173632 00000100:00100000:1.0:1783562403.714593:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 233 00000100:00100000:1.0:1783562403.714605:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11602:x1870200553173632:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783562403.714654:0:12218:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783562403.714788:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11602:x1870200553173632:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 185us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562403.714798:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 233 00000100:00080000:0.0:1783562403.714936:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562403.718719:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562403.719149:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553173888 00000100:00100000:1.0:1783562403.719163:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553173888 00000100:00100000:1.0:1783562403.719247:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 234 00000100:00100000:1.0:1783562403.719348:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+26:11602:x1870200553173888:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562403.719377:0:5754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562403.719441:0:5754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b88d9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21556 expref: -99 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562403.719609:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562403.719628:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562403.719645:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562403.719661:0:5754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783562403.720163:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b88d9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21556 expref: 29 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562403.720185:0:5754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21556 expref: 28 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562403.720194:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562403.720198:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562403.720201:0:5754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683600, rc 0) 00000100:00100000:1.0:1783562403.720354:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11602:x1870200553173888:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1669us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1783562403.720363:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 234 00000100:00100000:2.0:1783562403.726612:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562403.726676:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562403.726730:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553174272 00000100:00100000:3.0:1783562403.726742:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553174272 00000100:00100000:0.0:1783562403.726767:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553174016 00000100:00100000:0.0:1783562403.726787:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553174016 00000100:00100000:3.0:1783562403.726855:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 235 00000100:00100000:3.0:1783562403.726867:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:11602:x1870200553174272:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783562403.726908:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:0.0:1783562403.726919:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefaff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:2363:x1870200553174016:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562403.726932:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562403.726960:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b88da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21556 expref: 29 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.726964:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.726984:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.727001:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562403.732558:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:0.0:1783562403.732956:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562403.732963:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.732976:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.733043:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.733051:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1e884f0) 00000100:00100000:0.0:1783562403.733057:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefaff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:2363:x1870200553174016:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 6134us (6450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562403.733070:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00010000:00010000:3.0:1783562403.733111:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.733143:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.733164:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562403.733167:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783562403.733172:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562403.733179:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88db3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562403.733387:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11602:x1870200553174272:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 6522us (6709us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783562403.733396:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 235 00000040:00080000:0.0:1783562403.735120:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562403.735129:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562403.735621:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783562403.735631:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783562403.736570:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562403.736655:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553174528 00000100:00100000:3.0:1783562403.736666:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553174528 00000100:00100000:3.0:1783562403.736727:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:3.0:1783562403.736739:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+28:11602:x1870200553174528:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783562403.737020:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:11602:x1870200553174528:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 283us (456us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783562403.737028:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00010000:00010000:2.0:1783562403.766543:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783562404.708289:0:12419:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783562404.708298:0:12419:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562404.708351:0:12419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783562404.708356:0:12419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1783562404.756599:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1783562404.756622:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1783562404.756632:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1783562404.790926:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562404.795734:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562404.795828:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553174784 00000100:00100000:3.0:1783562404.795839:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553174784 00000100:00100000:3.0:1783562404.795893:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 236 00000100:00100000:3.0:1783562404.795902:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+29:11622:x1870200553174784:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562404.796059:0:12218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562404.796082:0:12218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88dba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2155d expref: -99 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562404.796189:0:12218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88dc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562404.796205:0:12218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562404.796219:0:12218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562404.796231:0:12218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783562404.800313:0:12218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b88dba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2155d expref: 32 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562404.802971:0:12218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2155d expref: 31 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562404.802984:0:12218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:3.0:1783562404.802986:0:12218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783562404.802990:0:12218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:3.0:1783562404.803066:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11622:x1870200553174784:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 7163us (7340us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783562404.803076:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 236 00000100:00100000:3.0:1783562404.806927:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562404.806976:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553174912 00000100:00100000:1.0:1783562404.806993:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553174912 00000100:00100000:1.0:1783562404.807067:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 237 00000100:00100000:1.0:1783562404.807078:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11622:x1870200553174912:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562404.807143:0:5754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807161:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807174:0:5754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807201:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807208:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807216:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807223:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562404.807228:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807236:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807249:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562404.807252:0:5754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562404.807256:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562404.807275:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b88dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562404.807365:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11622:x1870200553174912:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 287us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562404.807372:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 237 00000100:00100000:2.0:1783562404.855023:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562404.855166:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175040 00000100:00100000:0.0:1783562404.855198:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175040 00000100:00100000:0.0:1783562404.855369:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:0.0:1783562404.855384:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2363:x1870200553175040:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562404.855464:0:6550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562404.855504:0:6550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b88dd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21564 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562404.855540:0:6550:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a4f00a0, atime: 0x6a4f00a0, ctime: 0x6a4f00a0, blocks: 0xb 00010000:00010000:0.0:1783562404.855567:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=214s v=(0 0) 00010000:00010000:0.0:1783562404.855572:0:6550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562404.855597:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b88dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21564 expref: 8 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562404.855615:0:6550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b88dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21564 expref: 8 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562404.855767:0:6550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb9800, rc 0) 00000100:00100000:0.0:1783562404.855845:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2363:x1870200553175040:12345-192.168.204.4@tcp:101:cat.0 Request processed in 466us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562404.855853:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00080000:1.0:1783562404.856525:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562404.859389:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562404.859520:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175168 00000100:00100000:2.0:1783562404.859541:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175168 00002000:00100000:2.0:1783562404.859619:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bfcef1aad80 x1870200553175168/t0(0) o3->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:245/0 lens 488/0 e 0 to 0 dl 1783562415 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562404.859633:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef1aad80 with x1870200553175168 ext(0->4095) 00002000:00010000:2.0:1783562404.859641:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef1aad80 00000100:00100000:2.0:1783562404.859683:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:2.0:1783562404.859700:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2362:x1870200553175168:12345-192.168.204.4@tcp:3:cat.0 00000100:00100000:2.0:1783562404.859995:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2362:x1870200553175168:12345-192.168.204.4@tcp:3:cat.0 Request processed in 297us (614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783562404.860015:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00002000:00100000:2.0:1783562404.860025:0:6554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bfcef1aad80 x1870200553175168/t0(0) o3->aeded353-5c04-404d-8ca0-d71cfbeced3d@192.168.204.4@tcp:245/0 lens 488/4536 e 0 to 0 dl 1783562415 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783562404.860033:0:6554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcef1aad80 with x1870200553175168 ext(0->4095) 00002000:00010000:2.0:1783562404.860036:0:6554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcef1aad80 00000100:00100000:3.0:1783562405.308814:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562405.308891:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562405.308933:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562405.308965:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562405.309020:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562405.309067:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175552 00000100:00100000:3.0:1783562405.309083:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175552 00000100:00100000:3.0:1783562405.309150:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175680 00000100:00100000:3.0:1783562405.309153:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175680 00000100:00100000:3.0:1783562405.309176:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:3.0:1783562405.309189:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553175552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562405.309278:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553175552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562405.309286:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:3.0:1783562405.309317:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:3.0:1783562405.309324:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2362:x1870200553175680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562405.309343:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175296 00000100:00100000:2.0:1783562405.309348:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175296 00000100:00100000:3.0:1783562405.309351:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+8:2362:x1870200553175680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562405.309358:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:3.0:1783562405.309377:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175424 00000100:00100000:3.0:1783562405.309380:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175424 00000100:00100000:2.0:1783562405.309383:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 267 00000100:00100000:2.0:1783562405.309390:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553175296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562405.309438:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175808 00000100:00100000:3.0:1783562405.309442:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175808 00000100:00100000:2.0:1783562405.309453:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553175296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 65us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562405.309460:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 267 00000100:00100000:3.0:1783562405.309464:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:3.0:1783562405.309469:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2362:x1870200553175424:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562405.309509:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:2362:x1870200553175424:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562405.309517:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:3.0:1783562405.309528:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00080000:2.0:1783562405.309529:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783562405.309534:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562405.309535:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553175808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562405.309563:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:2361:x1870200553175808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562405.309569:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00010000:00010000:1.0:1783562405.815650:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562406.838665:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562407.590599:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562407.590716:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553175936 00000100:00100000:0.0:1783562407.590736:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553175936 00000100:00080000:2.0:1783562407.590827:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562407.590838:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 238 00000100:00100000:0.0:1783562407.590860:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11268:x1870200553175936:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783562407.591151:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11268:x1870200553175936:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 Request processed in 301us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562407.591160:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 238 00000100:00100000:2.0:1783562407.593688:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562407.594382:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176192 00000100:00100000:0.0:1783562407.594398:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176192 00000100:00100000:0.0:1783562407.594559:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:0.0:1783562407.594575:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+31:11268:x1870200553176192:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562407.596029:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+32:11268:x1870200553176192:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1452us (2351us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783562407.596043:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:3.0:1783562407.741306:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562407.742587:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176320 00000100:00100000:0.0:1783562407.742635:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176320 00000100:00100000:0.0:1783562407.742747:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 239 00000100:00100000:0.0:1783562407.742759:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+5:12073:x1870200553176320:12345-192.168.204.4@tcp:101:lsof.0 00000100:00080000:2.0:1783562407.742839:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783562407.743182:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562407.743215:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2156b expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.743511:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.743530:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.743546:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562407.744116:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783562407.744123:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562407.744210:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.744251:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9c00/0x4738ba0933b88ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2156b expref: 7 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.744274:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2156b expref: 6 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562407.744285:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562407.744289:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562407.744293:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8a00, rc 0) 00000100:00100000:0.0:1783562407.746157:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:12073:x1870200553176320:12345-192.168.204.4@tcp:101:lsof.0 Request processed in 3381us (4850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562407.746173:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 239 00000001:00080000:2.0:1783562407.831922:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1783562407.831940:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1783562407.844499:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:0.0:1783562407.844533:0:12329:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783562407.844616:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcd8139e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1783562407.844616:0:12329:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1783562407.844625:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfd00def400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcd8139600 00000020:00080000:1.0:1783562407.844631:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfd00defb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef9c6000 00000020:00080000:0.0:1783562407.844755:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783562407.845021:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1783562407.845261:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783562407.845381:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562407.845643:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632384 00000100:00100000:0.0:1783562407.845653:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632384 00000100:00080000:1.0:1783562407.845718:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562407.845729:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783562407.845745:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563632384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783562407.846166:0:6549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783562407.846171:0:6549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783562400 -> 1783562400 00002000:00010000:2.0:1783562407.846175:0:6549:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1783562400 -> 1783562400 00002000:00010000:2.0:1783562407.846177:0:6549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783562400 -> 1783562400 00002000:00010000:2.0:1783562407.846179:0:6549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783562407.846248:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563632384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 507us (865us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783562407.846257:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783562407.846576:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1783562407.846585:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1783562407.846996:0:3273:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfcf7122680 x1870200563632384/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783562423 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783562407.847013:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcf7122680/2, rc 0, transno 4294967325 00000100:00100000:1.0:1783562407.847019:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632384:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1783562407.863118:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562408.310738:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632896:0@lo:400:kworker.0 00000100:00100000:1.0:1783562408.310817:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562408.310889:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562408.310909:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563632768:0@lo:400:kworker.0 00000100:00100000:1.0:1783562408.310950:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562408.310985:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632896 00000100:00100000:1.0:1783562408.310991:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632896 00000100:00100000:1.0:1783562408.311055:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783562408.311066:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563632896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562408.311127:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563632896:12345-0@lo:400:kworker.0 Request processed in 63us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562408.311136:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1783562408.311159:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562408.311186:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783562408.311192:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1783562408.311217:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcefafca80, transno 4294967310 00000100:00100000:1.0:1783562408.311230:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563632896:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.313791:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563632512:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.313895:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562408.313975:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563633024:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.314019:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562408.314061:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783562408.314072:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563632640:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.314103:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562408.314159:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632768 00000100:00100000:0.0:1783562408.314168:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632768 00000100:00100000:0.0:1783562408.314632:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633024 00000100:00100000:0.0:1783562408.314638:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633024 00000100:00100000:0.0:1783562408.314673:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632640 00000100:00100000:0.0:1783562408.314677:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632640 00000100:00100000:0.0:1783562408.314817:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783562408.314831:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563632768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.314912:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563632768:12345-0@lo:400:kworker.0 Request processed in 85us (3960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562408.314937:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783562408.314964:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783562408.314974:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563633024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.315020:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563633024:12345-0@lo:400:kworker.0 Request processed in 49us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562408.315027:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783562408.315049:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783562408.315058:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563632640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.315097:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563632640:12345-0@lo:400:kworker.0 Request processed in 41us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562408.315105:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1783562408.315157:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562408.315480:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563632640:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.315496:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563633024:0@lo:400:kworker.0 00000100:00100000:0.0:1783562408.315541:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563632768:0@lo:400:kworker.0 00000100:00100000:1.0:1783562408.315804:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563632512 00000100:00100000:1.0:1783562408.315812:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563632512 00000100:00100000:1.0:1783562408.315851:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783562408.315859:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563632512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562408.315903:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563632512:12345-0@lo:400:kworker.0 Request processed in 45us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562408.315910:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783562408.316009:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563632512:0@lo:400:kworker.0 00000100:00100000:2.0:1783562408.822700:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562408.822727:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563633152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562408.822815:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562408.822944:0:8024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633152 00000100:00100000:3.0:1783562408.822953:0:8024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633152 00000100:00100000:3.0:1783562408.823016:0:8024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783562408.823027:0:8024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563633152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562408.823068:0:8024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562408.823137:0:8024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563633152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562408.823145:0:8024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783562408.823371:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563633152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562408.823551:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563633280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562408.823587:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562408.823661:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633280 00000100:00100000:1.0:1783562408.823666:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633280 00000100:00100000:1.0:1783562408.823730:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783562408.823738:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563633280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783562408.823816:0:6552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562408.823919:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563633280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562408.824022:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563633280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562408.824145:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1783562408.886646:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783562409.509725:0:12621:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:00:07 (1783562407) 00010000:00010000:1.0:1783562409.910826:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562410.428627:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562410.428674:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562410.428709:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562410.428743:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562410.428771:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562410.428886:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176576 00000100:00100000:0.0:1783562410.428898:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176576 00000100:00100000:0.0:1783562410.428967:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176960 00000100:00100000:0.0:1783562410.428970:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176960 00000100:00100000:0.0:1783562410.428998:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:0.0:1783562410.429010:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:2361:x1870200553176576:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1783562410.429017:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562410.429037:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:1.0:1783562410.429049:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2361:x1870200553176960:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562410.429104:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:2361:x1870200553176576:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 95us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562410.429118:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:3.0:1783562410.429204:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176832 00000100:00100000:3.0:1783562410.429208:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176832 00000100:00100000:3.0:1783562410.429241:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176704 00000100:00100000:3.0:1783562410.429244:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176704 00000100:00100000:3.0:1783562410.429265:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:3.0:1783562410.429272:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553176832:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562410.429345:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2361:x1870200553176960:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 298us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562410.429352:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:1.0:1783562410.429386:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:1.0:1783562410.429395:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553176704:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562410.429442:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2361:x1870200553176704:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562410.429448:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00080000:1.0:1783562410.429465:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562410.429468:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562410.429509:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553176448 00000100:00100000:1.0:1783562410.429514:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553176448 00000100:00100000:1.0:1783562410.429545:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 269 00000100:00100000:1.0:1783562410.429552:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553176448:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562410.429582:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553176448:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562410.429590:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 269 00000100:00100000:3.0:1783562410.431918:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc3ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2361:x1870200553176832:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2634us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562410.431931:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00010000:00010000:2.0:1783562410.935873:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562411.163219:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.163359:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553177216 00000100:00100000:3.0:1783562411.163380:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553177216 00000100:00100000:3.0:1783562411.163475:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:3.0:1783562411.163485:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+18:12294:x1870200553177216:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:3.0:1783562411.164855:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:12294:x1870200553177216:12345-192.168.204.4@tcp:35:umount.0 Request processed in 1365us (1639us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1783562411.164866:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:0.0:1783562411.170163:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562411.170272:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553177472 00000100:00100000:2.0:1783562411.170282:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553177472 00000100:00100000:2.0:1783562411.170343:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:2.0:1783562411.170371:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+19:12294:x1870200553177472:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:2.0:1783562411.170804:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:12294:x1870200553177472:12345-192.168.204.4@tcp:35:umount.0 Request processed in 452us (652us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783562411.170810:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:2.0:1783562411.175067:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.175223:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553177728 00000100:00100000:3.0:1783562411.175233:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553177728 00000100:00100000:3.0:1783562411.175380:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:3.0:1783562411.175396:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5194050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+20:12294:x1870200553177728:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:3.0:1783562411.175883:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5194050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:12294:x1870200553177728:12345-192.168.204.4@tcp:35:umount.0 Request processed in 492us (834us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783562411.175891:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562411.180212:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562411.180448:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553177984 00000100:00100000:2.0:1783562411.180463:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553177984 00000100:00100000:2.0:1783562411.180540:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:2.0:1783562411.180553:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:12294:x1870200553177984:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:2.0:1783562411.181151:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:12294:x1870200553177984:12345-192.168.204.4@tcp:35:umount.0 Request processed in 599us (952us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783562411.181164:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:0.0:1783562411.183727:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562411.183765:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.183865:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553178240 00000100:00100000:3.0:1783562411.183878:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553178240 00000100:00100000:3.0:1783562411.183970:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553178112 00000100:00100000:3.0:1783562411.183974:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553178112 00000100:00100000:3.0:1783562411.184008:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562411.184021:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+14:2361:x1870200553178240:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562411.184043:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562411.184069:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337a00/0x4738ba0933b87dbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210b7 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562411.184095:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562411.184158:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+13:2361:x1870200553178240:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562411.184187:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562411.184208:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:3.0:1783562411.184215:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+12:2363:x1870200553178112:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562411.184225:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562411.184234:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337000/0x4738ba0933b87e55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210ef expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562411.184244:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562411.184261:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea73df88-a302-4824-bca9-4d5c686fd328+11:2363:x1870200553178112:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 47us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562411.184267:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:0.0:1783562411.184623:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562411.184705:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553178368 00000100:00100000:2.0:1783562411.184711:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553178368 00000100:00100000:2.0:1783562411.184750:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562411.184758:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef107480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+11:2363:x1870200553178368:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562411.184766:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562411.184777:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1498a00/0x4738ba0933b88038 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211ba expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562411.184797:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562411.184825:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef107480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea73df88-a302-4824-bca9-4d5c686fd328+10:2363:x1870200553178368:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562411.184832:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:0.0:1783562411.185849:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562411.185960:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553178752 00000100:00100000:1.0:1783562411.185968:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553178752 00000100:00100000:1.0:1783562411.186172:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:1.0:1783562411.186182:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+7:2360:x1870200553178752:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:1.0:1783562411.186215:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88395 00000020:00010000:1.0:1783562411.186227:0:6608:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcc3839800: total 0 00000100:00080000:1.0:1783562411.186233:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9bfcef6a1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783562411.186288:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1783562411.186478:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcc3839800: total 0 00010000:00010000:2.0:1783562411.186522:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcc3839800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1783562411.186574:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b88738 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21396 expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562411.186603:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b88dd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21564 expref: 5 pid: 6550 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562411.186613:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcc3839800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1783562411.186620:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562411.186622:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562411.186623:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562411.186830:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+2:2360:x1870200553178752:12345-192.168.204.4@tcp:9:umount.0 Request processed in 649us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562411.186843:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:1.0:1783562411.189800:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562411.189912:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553178880 00000100:00100000:2.0:1783562411.189927:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553178880 00000100:00100000:2.0:1783562411.190033:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:2.0:1783562411.190047:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+5:2360:x1870200553178880:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:2.0:1783562411.190089:0:6549:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b8812d 00000100:00080000:2.0:1783562411.190104:0:6549:0:(import.c:65:import_set_state_nolock()) ffff9bfcc364a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783562411.190162:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783562411.190576:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeded353-5c04-404d-8ca0-d71cfbeced3d+2:2360:x1870200553178880:12345-192.168.204.4@tcp:9:umount.0 Request processed in 531us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562411.190585:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00010000:00010000:1.0:1783562411.190889:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562411.196389:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.196640:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553179904 00000100:00100000:3.0:1783562411.196651:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553179904 00000100:00100000:3.0:1783562411.196728:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 240 00000100:00100000:3.0:1783562411.196742:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+22:2360:x1870200553179904:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:3.0:1783562411.196804:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87dc9 00000020:00010000:3.0:1783562411.196826:0:6572:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfbc6944800: total 0 00000100:00080000:3.0:1783562411.196832:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6944000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783562411.196956:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1783562411.197586:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeded353-5c04-404d-8ca0-d71cfbeced3d+21:2360:x1870200553179904:12345-192.168.204.4@tcp:39:umount.0 Request processed in 845us (1217us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1783562411.197596:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 240 00000020:00010000:1.0:1783562411.198349:0:8323:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfbc6944800: total 0 00010000:00010000:1.0:1783562411.198547:0:8323:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfbc6944800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783562411.198595:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfce234e700) 00010000:00010000:1.0:1783562411.198600:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562411.198611:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb9a00/0x4738ba0933b880af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211cf expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198645:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562411.198648:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783562411.198653:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1cc00/0x4738ba0933b88723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2138f expref: 19 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198669:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562411.198672:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783562411.198676:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b88dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2155d expref: 18 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198719:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562411.198722:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562411.198726:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b88cb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21517 expref: 17 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198740:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562411.198742:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562411.198746:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b883f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c212bd expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198758:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562411.198760:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783562411.198764:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499600/0x4738ba0933b887b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b9 expref: 15 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198776:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bfcc9774b00) 00010000:00010000:1.0:1783562411.198778:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562411.198781:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b88a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2148b expref: 14 pid: 12218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198798:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562411.198800:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562411.198804:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b88619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21349 expref: 13 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198817:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc9774c00) 00010000:00010000:1.0:1783562411.198820:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562411.198830:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b88093 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211c8 expref: 12 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198849:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bfcc4c37300) 00010000:00010000:1.0:1783562411.198851:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562411.198855:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c000/0x4738ba0933b886f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21381 expref: 11 pid: 5754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198871:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bfcc4c37d00) 00010000:00010000:1.0:1783562411.198873:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783562411.198877:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b88103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211e4 expref: 10 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198961:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bfcc89ea800) 00010000:00010000:1.0:1783562411.198964:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562411.198969:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683a00/0x4738ba0933b88d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2154f expref: 9 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.198983:0:8323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562411.198986:0:8323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562411.198990:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d800/0x4738ba0933b8879a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c213b2 expref: 8 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.199000:0:8323:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfbc6944800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783562411.199015:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562411.199017:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562411.199019:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562411.901460:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.902105:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180160 00000100:00100000:3.0:1783562411.902128:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180160 00000100:00100000:3.0:1783562411.902253:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:3.0:1783562411.902280:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+10:2364:x1870200553180160:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562411.902345:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562411.902385:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b87ea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2112e expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562411.902464:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562411.902571:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea73df88-a302-4824-bca9-4d5c686fd328+9:2364:x1870200553180160:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 287us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562411.902583:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562411.903396:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562411.903564:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180032 00000100:00100000:1.0:1783562411.903578:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180032 00000100:00100000:1.0:1783562411.903678:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1783562411.903691:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ea73df88-a302-4824-bca9-4d5c686fd328+9:2363:x1870200553180032:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562411.903710:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562411.903736:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8e00/0x4738ba0933b87e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21104 expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562411.903762:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562411.903833:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ea73df88-a302-4824-bca9-4d5c686fd328+8:2363:x1870200553180032:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 145us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562411.903841:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1783562411.907023:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562411.909918:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180288 00000100:00100000:3.0:1783562411.909936:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180288 00000100:00100000:3.0:1783562411.910175:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:3.0:1783562411.910188:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+8:2363:x1870200553180288:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562411.910209:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562411.910247:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1c200/0x4738ba0933b88031 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c211b3 expref: 8 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562411.910268:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562411.910382:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea73df88-a302-4824-bca9-4d5c686fd328+7:2363:x1870200553180288:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 196us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562411.910391:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:0.0:1783562411.910679:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562411.910746:0:12218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180544 00000100:00100000:2.0:1783562411.910752:0:12218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180544 00000100:00100000:2.0:1783562411.910798:0:12218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 241 00000100:00100000:2.0:1783562411.910808:0:12218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+6:2360:x1870200553180544:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:2.0:1783562411.910848:0:12218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87eb0 00000020:00010000:2.0:1783562411.910858:0:12218:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcef3ac800: total 0 00000100:00080000:2.0:1783562411.910866:0:12218:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3ae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783562411.910892:0:12218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1783562411.910903:0:7446:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcef3ac800: total 0 00010000:00010000:0.0:1783562411.910962:0:7446:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcef3ac800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783562411.911006:0:7446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562411.911012:0:7446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562411.911021:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc5cb8a00/0x4738ba0933b88de4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2156b expref: 6 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562411.911057:0:7446:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcef3ac800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783562411.911078:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562411.911083:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562411.911087:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562411.911139:0:12218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:952ad7e8-5645-4c1a-9bc5-e30bd45f3803+3:2360:x1870200553180544:12345-192.168.204.4@tcp:39:umount.0 Request processed in 332us (463us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1783562411.911148:0:12218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 241 00000100:00100000:0.0:1783562411.947886:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562411.948011:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180800 00000100:00100000:1.0:1783562411.948022:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180800 00000100:00100000:1.0:1783562411.948091:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 270 00000100:00100000:1.0:1783562411.948102:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+7:2360:x1870200553180800:12345-192.168.204.4@tcp:251:umount.0 00000020:00000080:1.0:1783562411.948155:0:5748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87da6 00000020:00010000:1.0:1783562411.948164:0:5748:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcef3a9000: total 0 00000100:00080000:1.0:1783562411.948170:0:5748:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3a9800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783562411.948258:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd0337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea73df88-a302-4824-bca9-4d5c686fd328+3:2360:x1870200553180800:12345-192.168.204.4@tcp:251:umount.0 Request processed in 158us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562411.948266:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 270 00000020:00010000:3.0:1783562411.949532:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcef3a9000: total 0 00010000:00010000:3.0:1783562411.949539:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562411.949584:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcef3a9000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783562411.949620:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337600/0x4738ba0933b87e5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c210f6 expref: 2 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562411.949637:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcef3a9000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783562411.949646:0:5743:0:(genops.c:906:class_export_put()) final put ffff9bfcef3a9000/ea73df88-a302-4824-bca9-4d5c686fd328 00010000:00010000:3.0:1783562411.949681:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562411.949684:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562411.949685:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562411.950020:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef3a9000/ea73df88-a302-4824-bca9-4d5c686fd328 for MGS 00000020:00000080:2.0:1783562411.950062:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef3a9800 for MGS 00010000:00010000:1.0:1783562411.958605:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562411.958916:0:11488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562411.958923:0:11488:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562411.959235:0:11488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1783562411.959242:0:11488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:0.0:1783562412.951727:0:12329:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00100000:3.0:1783562412.951729:0:12330:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00000001:00080000:3.0:1783562412.951754:0:12330:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1783562412.951763:0:12330:0:(genops.c:906:class_export_put()) final put ffff9bfcef3ac800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 00000001:00100000:0.0:1783562412.951767:0:12329:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000001:00080000:0.0:1783562412.951780:0:12329:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1783562412.951812:0:12330:0:(genops.c:906:class_export_put()) final put ffff9bfbc6944800/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:3.0:1783562412.951856:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef3ac800/952ad7e8-5645-4c1a-9bc5-e30bd45f3803 for lustre-MDT0000 00000020:00000080:3.0:1783562412.951941:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6944800/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-MDT0000 00000020:00000080:3.0:1783562412.951989:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef3ae000 for lustre-MDT0000 00000020:00000080:3.0:1783562412.951997:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6944000 for lustre-MDT0000 00000020:00080000:0.0:1783562412.952017:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783562412.952095:0:5787:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00100000:1.0:1783562412.963050:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:1.0:1783562412.963063:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfcc3839800/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:3.0:1783562412.963112:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3839800/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-OST0001 00000001:00080000:1.0:1783562412.963116:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000020:00000080:3.0:1783562412.963182:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef6a1800 for lustre-OST0001 00000020:01000004:3.0:1783562412.967852:0:12821:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783562412.976574:0:12821:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783562412.976626:0:12821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562412.976641:0:12821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562412.976649:0:12821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562412.976657:0:12821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562412.976691:0:12821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783562412.976697:0:12821:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1783562412.976730:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562412.976742:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783562412.976775:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1783562412.976777:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562412.976783:0:8323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562412.976788:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783562412.976797:0:12821:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1783562412.976799:0:8323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562412.976810:0:8323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562412.976817:0:8323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562412.976820:0:8323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:3.0:1783562412.976824:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6884000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:1.0:1783562412.976825:0:8323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1783562412.976897:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563633408:0@lo:39:umount.0 00000100:00100000:0.0:1783562412.976962:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562412.977064:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633408 00000100:00100000:3.0:1783562412.977072:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633408 00010000:00010000:1.0:1783562412.977080:0:8323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562412.977091:0:8323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562412.977115:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562412.977124:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00010000:00010000:1.0:1783562412.977126:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337800/0x4738ba0933b87e2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e32 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562412.977136:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1870200563633408:12345-0@lo:39:umount.0 00010000:00010000:1.0:1783562412.977145:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562412.977149:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562412.977152:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562412.977162:0:5754:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87bca 00000100:00080000:3.0:1783562412.977170:0:5754:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6887800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783562412.977233:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562412.977251:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3271:x1870200563633408:12345-0@lo:39:umount.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562412.977261:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1783562412.977273:0:5754:0:(genops.c:906:class_export_put()) final put ffff9bfcf6886800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783562412.977307:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563633536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562412.977356:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1783562412.977390:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6886800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1783562412.977452:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633536 00000100:00100000:3.0:1783562412.977458:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633536 00000020:00000080:0.0:1783562412.977462:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf6887800 for lustre-MDT0000 00000100:00080000:1.0:1783562412.977468:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6884000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783562412.977500:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783562412.977506:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563633408:0@lo:39:umount.0 00000100:00100000:3.0:1783562412.977511:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3273:x1870200563633536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562412.977524:0:7447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562412.977541:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b87e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e2b expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783562412.977548:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783562412.977552:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00010000:00010000:3.0:1783562412.977556:0:7447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562412.977557:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1783562412.977598:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+18:3273:x1870200563633536:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562412.977605:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783562412.977624:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3273:1870200563633536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562412.978571:0:12821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978584:0:12821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978592:0:12821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978598:0:12821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978617:0:12821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562412.978623:0:12821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978629:0:12821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978643:0:12821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978649:0:12821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978669:0:12821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562412.978676:0:12821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978682:0:12821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978688:0:12821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978695:0:12821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978714:0:12821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783562412.978721:0:12821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978728:0:12821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978733:0:12821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978734:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783562412.978741:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978749:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498400 already unused, calling callback (ffffffffc1a65c20) 00010000:00010000:0.0:1783562412.978750:0:12821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562412.978753:0:8323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978761:0:8323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978761:0:12821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1783562412.978764:0:12821:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:2.0:1783562412.978768:0:8323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562412.978782:0:8323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783562412.978783:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:01000000:2.0:1783562412.978785:0:8323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783562412.978787:0:8323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1783562412.978787:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978793:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562412.978795:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978801:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562412.978807:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978810:0:8323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562412.978813:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562412.978815:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783562412.978816:0:8323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1783562412.978816:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783562412.978826:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978831:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562412.978836:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978837:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978843:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498400/0x4738ba0933b87e39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e40 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978844:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b87d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87d67 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978855:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562412.978858:0:8323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978862:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562412.978864:0:8323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498200 already unused, calling callback (ffffffffc1a65c20) 00010000:00010000:0.0:1783562412.978865:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562412.978867:0:8323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562412.978869:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562412.978871:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1a65c20) 00010000:00010000:2.0:1783562412.978874:0:8323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562412.978875:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562412.978882:0:8323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978883:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562412.978888:0:8323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783562412.978890:0:8323:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:00010000:0.0:1783562412.978890:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562412.978892:0:8323:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783562412.978895:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562412.978896:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783562412.978898:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783562412.978908:0:8323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978908:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978914:0:8323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562412.978914:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562412.978920:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978926:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b87b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87b29 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978930:0:8323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562412.978936:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498200/0x4738ba0933b8805b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88062 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562412.978936:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562412.978937:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562412.978943:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562412.978944:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562412.978945:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562412.978947:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783562412.978956:0:12821:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:2.0:1783562412.978959:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563633664:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1783562412.978960:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783562412.978964:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783562412.978969:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783562412.978974:0:12821:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bfcf684a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783562412.978979:0:12821:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bfbc6c2d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783562412.978984:0:12821:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9bfcf71299c0) has exports, disconnecting them 00000020:00080000:0.0:1783562412.978988:0:12821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bfcf684a800), last request at 1783562408 00000020:00000080:0.0:1783562412.978994:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87d28 00000100:00100000:2.0:1783562412.979005:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783562412.979009:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfcf684a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783562412.979045:0:12821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcf684a800): rc 0 00000020:00000080:0.0:1783562412.979048:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf684a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783562412.979056:0:12821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bfbc6c2d000), last request at 1783562408 00000020:00000080:0.0:1783562412.979059:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c4f 00000100:00080000:0.0:1783562412.979064:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c28000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783562412.979077:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf684a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1783562412.979083:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563634048:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1783562412.979110:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf684a000 for lustre-MDT0000 00000100:00100000:3.0:1783562412.979117:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562412.979121:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783562412.979131:0:12821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfbc6c2d000): rc 0 00000020:00000080:0.0:1783562412.979134:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfbc6c2d000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1783562412.979150:0:12821:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac9e01e4fae0 00000100:00100000:3.0:1783562412.979155:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563633920:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1783562412.979162:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6c2d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1783562412.979181:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1783562412.979188:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6c28000 for lustre-MDT0000 00000100:00080000:0.0:1783562412.979211:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783562412.979215:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:3.0:1783562412.979219:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633664 00000100:00100000:3.0:1783562412.979226:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633664 00000004:00080000:0.0:1783562412.979227:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783562412.979262:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563634048 00000100:00100000:3.0:1783562412.979266:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563634048 00000100:00100000:3.0:1783562412.979284:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633920 00000100:00100000:3.0:1783562412.979287:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633920 00000100:00080000:0.0:1783562412.979295:0:12821:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783562412.979304:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783562412.979309:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfceed15800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783562412.979314:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+20:3274:x1870200563633664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562412.979343:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1783562412.979344:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783562412.979348:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:0.0:1783562412.979358:0:12821:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bfcf7122680 x1870200563632384/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783562423 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783562412.979359:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b87e40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e39 expref: 20 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562412.979367:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562412.979376:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563633792:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1783562412.979379:0:12821:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcf7122680, transno 4294967325 00010000:00010000:3.0:1783562412.979386:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1783562412.979392:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783562412.979423:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562412.979470:0:11471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563633792 00000100:00100000:2.0:1783562412.979475:0:11471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563633792 00010000:00010000:1.0:1783562412.979478:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562412.979480:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3274:x1870200563633664:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562412.979490:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783562412.979498:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563634176:0@lo:9:umount.0 00000100:00100000:2.0:1783562412.979500:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783562412.979508:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563634048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562412.979516:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783562412.979517:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1783562412.979529:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1d400/0x4738ba0933b88062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b8805b expref: 19 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562412.979530:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+19:3272:x1870200563633920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562412.979534:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783562412.979545:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562412.979546:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562412.979558:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfd020c8000/0x4738ba0933b87b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87b22 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562412.979570:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563634176 00000100:00100000:2.0:1783562412.979573:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+17:3272:x1870200563634048:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562412.979574:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563634176 00010000:00010000:3.0:1783562412.979575:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562412.979591:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783562412.979611:0:11471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783562412.979612:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783562412.979613:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3272:x1870200563633920:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562412.979619:0:11471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+16:3274:x1870200563633792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562412.979619:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1870200563634176:12345-0@lo:9:umount.0 00010000:00010000:2.0:1783562412.979631:0:11471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783562412.979632:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1783562412.979643:0:6550:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c9c 00010000:00010000:2.0:1783562412.979644:0:11471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3c00/0x4738ba0933b87d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87d60 expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562412.979649:0:6550:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c2d800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783562412.979655:0:11471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562412.979665:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783562412.979673:0:6550:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1783562412.979686:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563634048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562412.979697:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3272:1870200563633920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562412.979728:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563633664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562412.979757:0:11471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8ed28a5-c620-431b-88b9-f6805bcdc0a6+14:3274:x1870200563633792:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562412.979763:0:11471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783562412.979788:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562412.979816:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3274:1870200563633792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562412.979834:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3271:x1870200563634176:12345-0@lo:9:umount.0 Request processed in 216us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562412.979840:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783562412.979855:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562412.979881:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfceed15800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783562412.979897:0:3271:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783562412.979899:0:3271:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562412.979902:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563634176:0@lo:9:umount.0 00000100:00080000:0.0:1783562412.979950:0:12821:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783562412.979962:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfcef650800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783562412.979999:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bfcf71299c0) has no exports 00000100:00100000:1.0:1783562412.980038:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563634304:0@lo:9:umount.0 00000100:00100000:1.0:1783562412.980068:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562412.980138:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563634304 00000100:00100000:2.0:1783562412.980142:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563634304 00000100:00100000:2.0:1783562412.980183:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783562412.980189:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1870200563634304:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783562412.980212:0:6547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87d98 00000100:00080000:2.0:1783562412.980217:0:6547:0:(import.c:65:import_set_state_nolock()) ffff9bfcf7132000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783562412.980233:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783562412.980240:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1783562412.980524:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562412.981143:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3271:x1870200563634304:12345-0@lo:9:umount.0 Request processed in 952us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562412.981151:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783562412.981164:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00080000:1.0:1783562412.981168:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef650800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783562412.981210:0:3271:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783562412.981262:0:3271:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562412.981266:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563634304:0@lo:9:umount.0 00010000:00010000:1.0:1783562412.983529:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783562412.985603:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bfcf71299c0) has no exports 00000020:00000080:0.0:1783562413.012509:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b7d 00000020:00000080:0.0:1783562413.012526:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcef187800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783562413.012543:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783562413.012619:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.012640:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783562413.012645:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9bfcc3f1cd40) has no exports 00000020:00000080:2.0:1783562413.012688:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef187800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783562413.013045:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b76 00000020:00000080:1.0:1783562413.013051:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfd00d40800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783562413.013121:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfd00d40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783562413.013282:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.013290:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783562413.013294:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfd00d42800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783562413.013296:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfd00d42800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783562413.013304:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1783562413.013505:0:12821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcc4c68f60 - data ffff9bfbc65c0510/ffff9bfcd0f3e000 00000020:01000000:1.0:1783562413.013633:0:12821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd0d265a0 - data ffff9bfce606b288/ffff9bfcf7014000 00000001:00000004:1.0:1783562413.030385:0:12821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1783562413.071535:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783562413.071543:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1783562413.071568:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562413.071571:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783562413.071979:0:6606:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783562413.071996:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1783562413.072018:0:6606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783562413.073311:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783562413.073316:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1783562413.073376:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562413.073379:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783562413.073791:0:7879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783562413.073795:0:7879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:2.0:1783562413.073804:0:7879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783562413.108705:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b45 00000020:00000080:1.0:1783562413.108718:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf7130800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783562413.109559:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b5a 00000020:00000080:1.0:1783562413.109565:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf7134800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562413.109599:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7130800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783562413.109658:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783562413.109668:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.109680:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783562413.109684:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9bfcf712b380) has no exports 00000020:00000080:3.0:1783562413.109708:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7134800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1783562413.109910:0:12821:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783562413.109922:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87d8a 00000020:00000080:1.0:1783562413.109927:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf6167000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783562413.109963:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783562413.109967:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.109974:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783562413.109978:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9bfcef648000) has no exports 00000020:00000080:1.0:1783562413.109984:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87d83 00000020:00000080:3.0:1783562413.109986:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6167000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783562413.109990:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcef651000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783562413.110011:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef651000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783562413.110509:0:12821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783562413.110516:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783562413.110522:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1783562413.110530:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562413.110533:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783562413.110627:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.110636:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562413.110645:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c95 00000020:00000080:1.0:1783562413.110651:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfbc6c2f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783562413.110711:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef650800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783562413.110718:0:37:0:(genops.c:906:class_export_put()) final put ffff9bfcef653800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783562413.110721:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef653800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783562413.110729:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783562413.110880:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783562413.110886:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.110891:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783562413.110895:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9bfcc6734d40) has no exports 00000020:00000080:1.0:1783562413.110900:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c8e 00000020:00000080:1.0:1783562413.110905:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcc7fb7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783562413.110922:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6c2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783562413.111447:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc7fb7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783562413.111513:0:12821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783562413.111517:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783562413.111522:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783562413.111527:0:12821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783562413.111529:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562413.111566:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfceed15800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783562413.111583:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.111590:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562413.111593:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfbc6943000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783562413.111596:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6943000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783562413.111602:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562413.111778:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.111785:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562413.111791:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcd170a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783562413.111794:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd170a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783562413.111800:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562413.111961:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b61 00000020:00000080:1.0:1783562413.111967:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf7136800/lustre-MDD0000_UUID 00000020:01000000:1.0:1783562413.111981:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783562413.111985:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.111989:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783562413.111993:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9bfcf7128000) has no exports 00000020:00000080:1.0:1783562413.112016:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.112020:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783562413.112024:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b68 00000020:00000080:1.0:1783562413.112028:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf7137000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783562413.112038:0:12821:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcc78df800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783562413.112042:0:12821:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc78df800 3 00000020:01000004:1.0:1783562413.112046:0:12821:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcc78df800 from lustre-MDT0000 00000020:00000080:1.0:1783562413.112071:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.112075:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783562413.112078:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf7135000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783562413.112080:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7135000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783562413.112085:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1783562413.112109:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7136800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:1.0:1783562413.112112:0:12821:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:3.0:1783562413.112115:0:37:0:(genops.c:906:class_export_put()) final put ffff9bfcf7133000/lustre-MDD0000_UUID 00000020:01000004:1.0:1783562413.112117:0:12821:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:00000080:3.0:1783562413.112119:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7133000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783562413.112122:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:01000000:3.0:1783562413.112126:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783562413.112126:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.112132:0:12821:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783562413.112137:0:12821:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9bfcc3ecc800 a8ed28a5-c620-431b-88b9-f6805bcdc0a6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783562413.112141:0:12821:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9bfcc5cfb380) has exports, disconnecting them 00000020:00080000:1.0:1783562413.112146:0:12821:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bfcc3ecc800), last request at 1783562276 00000020:00000080:1.0:1783562413.112160:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87b06 00000020:00010000:1.0:1783562413.112170:0:12821:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcc3ecc800: total 2 00000100:00080000:1.0:1783562413.112174:0:12821:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ec8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783562413.112239:0:12821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcc3ecc800): rc 0 00000020:00080000:1.0:1783562413.112243:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9bfcc5cfb380) has no exports 00000020:00010000:2.0:1783562413.112295:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcc3ecc800: total 2 00010000:00010000:2.0:1783562413.112338:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcc3ecc800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1783562413.112369:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336e00/0x4738ba0933b87dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87df3 expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783562413.112386:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7137000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1783562413.112433:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9200/0x4738ba0933b87e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e01 expref: 8 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112458:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b88046 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b8803f expref: 7 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112469:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8c00/0x4738ba0933b87e16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e0f expref: 6 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112484:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8000/0x4738ba0933b88054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b8804d expref: 5 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112498:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b87e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e1d expref: 4 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112514:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfd020c9600/0x4738ba0933b87c02 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87bfb expref: 3 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112526:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9000/0x4738ba0933b87e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b87e47 expref: 2 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562413.112548:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcc3ecc800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1783562413.112561:0:5743:0:(genops.c:906:class_export_put()) final put ffff9bfcc3ecc800/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 00010000:00010000:2.0:1783562413.112578:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562413.112581:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562413.112583:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562413.112591:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3ecc800/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 for MGS 00000020:00000080:2.0:1783562413.112611:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc3ec8000 for MGS 00000100:00100000:3.0:1783562413.112687:0:5749:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bfcd81acc00:5749] 1 exiting: rc = 0 00000100:00100000:1.0:1783562413.112691:0:5750:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bfcd8111400:5750] 2 exiting: rc = 0 00000100:00100000:1.0:1783562413.112921:0:5748:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bfcc78b1600:5748] 0 exiting: rc = 1 00000100:00100000:1.0:1783562413.112984:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.112992:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.112998:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113005:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113048:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113055:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113061:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113069:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113076:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113081:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113087:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113093:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113098:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113105:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113113:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113120:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113127:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113135:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113143:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113151:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113160:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113169:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113178:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113185:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113192:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113201:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113210:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113218:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113236:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113248:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113259:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113266:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113279:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113324:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113339:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113348:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113355:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113362:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113371:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113380:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113388:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113396:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113477:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113485:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113494:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113506:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113518:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113529:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113536:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113540:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113550:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113556:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113563:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113569:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113576:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113583:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113589:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113595:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113600:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113605:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113611:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113616:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113621:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.113635:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783562413.114061:0:12821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783562413.114065:0:12821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1783562413.114933:0:12821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcf6537900 - data ffff9bfce77306c0/ffff9bfcd8146400 00000020:01000000:1.0:1783562413.115068:0:12821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd4357840 - data ffff9bfce77731b0/ffff9bfcc6747000 00000020:00000080:1.0:1783562413.115847:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87aea 00000020:00000080:1.0:1783562413.115856:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcd9276800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783562413.115908:0:12821:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcc78df800 from MGS, refs=2 00000020:01000004:1.0:1783562413.115912:0:12821:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc78df800 2 00000020:01000004:1.0:1783562413.115916:0:12821:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcc78df800 from MGS 00000020:00000080:1.0:1783562413.115948:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.115956:0:12821:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783562413.115958:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcd9274000/MGS 00000020:00000080:1.0:1783562413.115961:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd9274000/MGS for MGS 00000020:01000000:1.0:1783562413.115968:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783562413.116024:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783562413.116028:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562413.116033:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783562413.116039:0:12821:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bfcf6882000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783562413.116044:0:12821:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9bfcc3f1b380) has exports, disconnecting them 00000020:00080000:1.0:1783562413.116049:0:12821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bfcf6882000), last request at 1783562277 00000020:00000080:1.0:1783562413.116053:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87bb5 00000020:00080000:1.0:1783562413.116063:0:12821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcf6882000): rc 0 00000020:00000080:1.0:1783562413.116067:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcf6882000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783562413.116087:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd9276800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783562413.116623:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6882000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783562413.118884:0:12821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783562413.118892:0:12821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562413.118901:0:12821:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783562413.118909:0:12821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562413.118953:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf6884000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783562413.119070:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562413.119079:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783562413.119084:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfd00d47800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783562413.119088:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfd00d47800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783562413.119094:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783562413.119159:0:12821:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc78df800 1 00000020:00000080:2.0:1783562413.119166:0:12821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87adc 00000020:00000080:2.0:1783562413.119171:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcd9277800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783562413.119191:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783562413.119196:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562413.119203:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd9277800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783562413.119210:0:12821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783562413.119214:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9bfcc5cfcd40) has no exports 00000020:00000080:3.0:1783562413.132290:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562413.132315:0:12821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783562413.132320:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcc78da800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783562413.132335:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc78da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783562413.132347:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783562413.132544:0:12821:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfcc78de800 00000020:01000000:3.0:1783562413.132587:0:12821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783562413.132592:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562413.132597:0:12821:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783562413.132602:0:12821:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9bfcc3f18000) has no exports 00000100:00100000:3.0:1783562413.132720:0:5756:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bfcc5c8a600:5756] 2 exiting: rc = 0 00000100:00100000:3.0:1783562413.132878:0:5754:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bfcc6748200:5754] 0 exiting: rc = 1 00000100:00100000:2.0:1783562413.133003:0:6572:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bfbc6906c00:6572] 3 exiting: rc = 0 00000100:00100000:0.0:1783562413.133021:0:5755:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bfcc5c8ae00:5755] 1 exiting: rc = 0 00000100:00100000:2.0:1783562413.133083:0:12218:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9bfcc5076800:12218] 4 exiting: rc = 0 00000100:00100000:3.0:1783562413.133305:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133318:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133339:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133349:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133361:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133372:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133382:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133392:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133400:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133441:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133450:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133460:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133470:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133479:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133489:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133498:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133509:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133519:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133531:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133540:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133552:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133563:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133572:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133592:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133602:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133616:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133628:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133640:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133652:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133664:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133674:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133685:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133696:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133702:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133710:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133716:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133722:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133729:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133735:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133742:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133749:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133758:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133769:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133778:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133788:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133799:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133810:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133821:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133831:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133841:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133852:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133860:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133869:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133878:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133888:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133898:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133907:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133917:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133936:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133945:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133956:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133967:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133985:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.133998:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.138540:0:5757:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bfcc5c8b400:5757] 0 exiting: rc = 1 00000100:00100000:1.0:1783562413.138570:0:11821:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9bfcf6739c00:11821] 2 exiting: rc = 0 00000100:00100000:2.0:1783562413.140230:0:5758:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bfcc5c8b000:5758] 1 exiting: rc = 0 00000100:00100000:3.0:1783562413.140310:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140319:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140337:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140346:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140352:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140359:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140364:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140370:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140376:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140382:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140388:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140393:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140418:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140425:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140431:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140436:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140441:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140446:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140453:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140460:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140467:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140475:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140485:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140496:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140508:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140519:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140531:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140540:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140550:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140565:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140570:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140576:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140582:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140592:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140602:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140612:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140622:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140631:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140639:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140646:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140655:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140663:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140672:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140681:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140689:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140701:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140712:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140722:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140731:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140740:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140749:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140759:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140768:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140776:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140785:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140793:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140802:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140813:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140822:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140831:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140842:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140853:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140862:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.140872:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141474:0:5759:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bfcc5c8da00:5759] 0 exiting: rc = 1 00000100:00100000:0.0:1783562413.141526:0:5760:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bfcc5c8dc00:5760] 1 exiting: rc = 0 00000100:00100000:1.0:1783562413.141580:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141591:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141598:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141605:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141613:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141629:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141637:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141645:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141651:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141657:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141663:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141680:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141687:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141694:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141700:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141707:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141713:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141720:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141726:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141733:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141739:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141746:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141752:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141773:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141780:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141786:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141793:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141799:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141805:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141812:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141819:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141826:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141832:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141840:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141847:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141869:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141876:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141883:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141889:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141896:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141908:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141913:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141920:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141926:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141932:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141939:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141945:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141968:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.141975:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142000:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142008:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142015:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142022:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142027:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142033:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142038:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142043:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142049:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142055:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142076:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142085:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142093:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142100:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.142115:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562413.149074:0:5761:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bfcc5c8ce00:5761] 0 exiting: rc = 1 00000100:00100000:3.0:1783562413.149107:0:5762:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bfcc5c8c600:5762] 1 exiting: rc = 0 00000100:00100000:0.0:1783562413.149521:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149538:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149551:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149564:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149581:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149592:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149601:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149609:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149621:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149630:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149641:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149652:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149662:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149672:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149693:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149700:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149707:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149713:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149717:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149723:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149728:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149732:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149736:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149740:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149743:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149746:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149750:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149754:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149757:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149760:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149763:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149767:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149770:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149773:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149776:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149780:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149783:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149787:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149790:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149793:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149796:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149800:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149803:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149806:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149809:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149812:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149815:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149820:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149829:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149843:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149849:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149853:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149858:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149862:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149867:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149871:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149875:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149879:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149884:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149889:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149893:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149899:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149904:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.149909:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562413.150598:0:5763:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bfcc5c8cc00:5763] 0 exiting: rc = 1 00000100:00100000:3.0:1783562413.150746:0:5764:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bfcc5c8d400:5764] 1 exiting: rc = 0 00000100:00100000:0.0:1783562413.150792:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150801:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150806:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150810:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150813:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150816:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150820:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150823:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150827:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150830:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150833:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150836:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150839:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150841:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150844:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150847:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150850:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150852:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150855:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150858:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150868:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150871:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150875:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150878:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150882:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150885:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150888:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150891:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150894:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150897:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150900:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150903:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150906:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150909:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150912:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150915:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150918:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150922:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150925:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150928:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150931:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150934:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150937:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150940:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150943:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150946:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150949:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150951:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150954:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150957:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150960:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150963:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150966:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150968:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150971:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150979:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150982:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150985:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150989:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150992:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150995:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.150999:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151002:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151005:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562413.151466:0:5766:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bfcc5c8de00:5766] 1 exiting: rc = 0 00000100:00100000:1.0:1783562413.151508:0:5765:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bfcc5c8c800:5765] 0 exiting: rc = 1 00000100:00100000:0.0:1783562413.151547:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151557:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151567:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151573:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151582:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151588:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151594:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151600:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151605:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151611:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151616:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151621:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151626:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151632:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151638:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151644:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151650:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151655:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151661:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151667:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151672:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151678:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151683:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151689:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151694:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151700:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151715:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151721:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151727:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151733:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151738:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151743:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151749:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151754:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151760:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151765:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151771:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151776:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151782:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151787:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151792:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151798:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151803:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151809:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151814:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151819:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151824:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151829:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151835:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151840:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151846:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151851:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151857:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151863:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151868:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151874:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151880:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151885:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151890:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151896:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151901:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151913:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151918:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.151923:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562413.152481:0:5768:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bfcc5c8ca00:5768] 1 exiting: rc = 0 00000100:00100000:3.0:1783562413.152562:0:5769:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bfcd00c4800:5769] 2 exiting: rc = 0 00000100:00100000:1.0:1783562413.152701:0:5767:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bfcc5c8c200:5767] 0 exiting: rc = 1 00000100:00100000:0.0:1783562413.152776:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152783:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152788:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152794:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152813:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152820:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152826:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152832:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152837:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152843:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152848:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152854:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152859:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152865:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152870:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152876:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152881:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152887:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152893:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152899:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152906:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152912:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152918:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152924:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152929:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152935:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152941:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152946:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152966:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152973:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152979:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152984:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.152996:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153002:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153008:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153013:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153018:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153024:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153030:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153035:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153040:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153045:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153050:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153056:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153062:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153067:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153074:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153079:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153085:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153091:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153096:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153102:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153134:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153142:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153149:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153155:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153160:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153165:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153170:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153176:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153183:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153194:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153199:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562413.153205:0:12821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783562413.157261:0:12821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562413.157272:0:12821:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783562413.157277:0:12821:0:(genops.c:906:class_export_put()) final put ffff9bfcd011f800/MDS_uuid 00000020:00000080:1.0:1783562413.157280:0:12821:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd011f800/MDS_uuid for MDS 00000020:01000000:1.0:1783562413.157285:0:12821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783562413.157571:0:12821:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1783562413.433469:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563634432:0@lo:400:kworker.0 00000100:00100000:0.0:1783562413.433492:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563634560:0@lo:400:kworker.0 00000400:00000100:0.0:1783562413.433572:0:3274:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563634560 offset 0 length 224: 4 00000400:00000100:1.0:1783562413.433610:0:3273:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563634432 offset 0 length 224: 4 00010000:00010000:3.0:1783562414.006985:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783562414.802255:0:12971:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783562414.807703:0:12971:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783562414.807761:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562414.807779:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562414.807787:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562414.807794:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562414.807830:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783562414.807837:0:12971:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783562414.807863:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783562414.807877:0:12971:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcf664a680 x1870200563634432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562414.807908:0:12971:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783562414.807917:0:12971:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783562414.807934:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562414.807946:0:7446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783562414.807948:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c2f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783562414.807960:0:7446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562414.807966:0:7446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562414.807978:0:7446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562414.807985:0:7446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562414.807992:0:7446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783562414.807995:0:7446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783562414.807997:0:7446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783562414.808028:0:7446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562414.808034:0:7446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783562414.808084:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563634688:0@lo:39:umount.0 00000400:00000100:1.0:1783562414.808137:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563634688 offset 0 length 224: 4 00000100:00100000:3.0:1783562414.808171:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563634432:0@lo:400:kworker.0 00000100:00100000:0.0:1783562414.808217:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563634816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562414.808275:0:7446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562414.808283:0:7446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336200/0x4738ba0933b87e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b87e16 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562414.808302:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562414.808319:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562414.808321:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562414.808342:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562414.808592:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563634816 00000100:00100000:3.0:1783562414.808600:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563634816 00000100:00100000:1.0:1783562414.808680:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783562414.808691:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1870200563634816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783562414.808700:0:5740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783562414 with bad export cookie 5132056324073880326 00000100:00100000:1.0:1783562414.816058:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1870200563634816:12345-0@lo:103:ldlm_bl.0 Request processed in 7351us (7700us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783562414.816081:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783562414.816165:0:3275:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783562414.816174:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0119800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783562414.816179:0:3275:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783562414.822491:0:3275:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783562414.822500:0:3275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783562414.822535:0:3275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfbc9294000 x1870200563634816/t0(0) o103->MGC192.168.204.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783562430 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783562414.822558:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783562414.822561:0:3275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783562414.822564:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783562414.822569:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0119800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783562414.822574:0:3275:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 86 00000100:00080000:0.0:1783562414.822585:0:3275:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcd0119800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562414.822763:0:3275:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9aca80 x1870200563634944/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783562414.823159:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563634944:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1783562414.823230:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870200563634944 offset 0 length 520: 4 00000100:00100000:1.0:1783562414.823346:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3275:1870200563634816:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1783562415.008679:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562415.008691:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfbc6c2b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783562415.008742:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:2.0:1783562415.008747:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfcc364b000/aeded353-5c04-404d-8ca0-d71cfbeced3d 00000020:00000080:1.0:1783562415.008892:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6c2b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783562415.008961:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc364b000/aeded353-5c04-404d-8ca0-d71cfbeced3d for lustre-OST0000 00000020:00000080:1.0:1783562415.008992:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6c2d800 for lustre-OST0000 00000020:00000080:1.0:1783562415.009000:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc364a000 for lustre-OST0000 00010000:00010000:1.0:1783562415.031477:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562416.054644:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562417.078668:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783562418.078112:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562418.078125:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfcf7131800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783562418.078264:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7131800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783562418.078331:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf7132000 for lustre-OST0001 00010000:00010000:2.0:1783562418.102557:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783562418.550861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783562418.550876:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783562418.551012:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563635072:0@lo:400:kworker.0 00000400:00000100:1.0:1783562418.551091:0:3272:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563635072 offset 0 length 224: 4 00010000:00010000:1.0:1783562419.126835:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562420.150814:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783562420.598597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783562420.598610:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783562420.598872:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563635200:0@lo:400:kworker.0 00000400:00000100:2.0:1783562420.598949:0:3273:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563635200 offset 0 length 224: 4 00010000:00010000:0.0:1783562421.174685:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562422.198808:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562423.222721:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562424.182544:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562414/real 1783562414] req@ffff9bfcef9aca80 x1870200563634944/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783562424 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562424.182584:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcef9aca80 x1870200563634944/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783562424 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562424.182596:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562414/real 1783562414] req@ffff9bfcf664a300 x1870200563634688/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562424 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562424.182610:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcf664a300 x1870200563634688/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562424 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783562424.182626:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0119800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783562424.182650:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783562424.182673:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563634944:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1783562424.182678:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6c2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783562424.182692:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563634688:0@lo:39:umount.0 00000100:00080000:2.0:1783562424.182723:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562424.182729:0:12971:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783562424.182735:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783562424.182768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783562424.182776:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783562424.182779:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0119800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783562424.182786:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 224 00000100:00080000:0.0:1783562424.182792:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783562424.182800:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcd0119800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562424.182836:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcf664b480 x1870200563635328/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783562424.183160:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563635328:0@lo:250:kworker.0 00000100:00100000:1.0:1783562424.183166:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563635456:0@lo:400:kworker.0 00010000:00010000:2.0:1783562424.183822:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183837:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183845:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183852:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183894:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562424.183903:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183911:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183918:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183926:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562424.183943:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562424.183951:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562424.183960:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562424.183970:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498e00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562424.183975:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562424.183997:0:12971:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1783562424.184013:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562424.184021:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562424.184028:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562424.184031:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:01000004:2.0:1783562424.184032:0:12971:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:01000000:0.0:1783562424.184034:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000000:2.0:1783562424.184038:0:12971:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783562424.184045:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1783562424.184051:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00000020:00000080:2.0:1783562424.184052:0:12971:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1783562424.184058:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783562424.184059:0:12971:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9bfcc6730000) has no exports 00010000:00010000:0.0:1783562424.184070:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498e00/0x4738ba0933b87e1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87e24 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783562424.184090:0:12971:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9bfcc6730000) has no exports 00010000:00010000:0.0:1783562424.184099:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562424.184103:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562424.184110:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562424.184113:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562424.184131:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562424.184137:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562424.184151:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783562424.184154:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783562424.184156:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783562424.184162:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:0.0:1783562424.184165:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562424.184172:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b8804d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88054 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562424.184186:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562424.184188:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562424.184190:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562424.184198:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783562424.186053:0:12971:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd00b53c0 - data ffff9bfbc6664e58/ffff9bfcf663e400 00000400:00000100:1.0:1783562424.186622:0:3274:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563635456 offset 0 length 224: 4 00000400:00000100:3.0:1783562424.186840:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870200563635328 offset 0 length 520: 4 00000020:01000000:2.0:1783562424.190876:0:12971:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd035dd80 - data ffff9bfce602e870/ffff9bfbc6953400 00100000:10000000:2.0:1783562424.199787:0:12971:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783562424.220108:0:12971:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c1e 00000020:00000080:1.0:1783562424.220136:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfbc6945000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783562424.220202:0:12971:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcc7fb7800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783562424.220205:0:12971:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc7fb7800 2 00000020:01000004:1.0:1783562424.220208:0:12971:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcc7fb7800 from lustre-OST0000 00000020:00000080:1.0:1783562424.220236:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562424.220247:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783562424.220250:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfbc6947000/lustre-OST0000_UUID 00000020:00000080:1.0:1783562424.220253:0:12971:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6947000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783562424.220264:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783562424.220305:0:12971:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783562424.220310:0:12971:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783562424.220313:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562424.220317:0:12971:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783562424.220323:0:12971:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bfbc6c28800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783562424.220329:0:12971:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9bfcc5cf8000) has exports, disconnecting them 00000020:00080000:1.0:1783562424.220333:0:12971:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bfbc6c28800), last request at 1783562285 00000020:00000080:1.0:1783562424.220337:0:12971:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87c48 00000020:00080000:1.0:1783562424.220345:0:12971:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfbc6c28800): rc 0 00000020:00000080:1.0:1783562424.220349:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfbc6c28800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783562424.220738:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6945000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783562424.221876:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6c28800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783562424.225512:0:12971:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783562424.225523:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562424.225529:0:12971:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783562424.225536:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562424.225593:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6c2f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783562424.225764:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562424.225774:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783562424.225786:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfcf684f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783562424.225791:0:12971:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf684f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783562424.225808:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783562424.225875:0:12971:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc7fb7800 1 00000020:00000080:2.0:1783562424.225882:0:12971:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87bd8 00000020:00000080:2.0:1783562424.225905:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfced846800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783562424.225917:0:12971:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783562424.225932:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562424.225938:0:12971:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783562424.225943:0:12971:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9bfcc67319c0) has no exports 00000020:00000080:3.0:1783562424.225949:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfced846800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783562424.239866:0:12971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562424.239886:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783562424.239893:0:12971:0:(genops.c:906:class_export_put()) final put ffff9bfcc7fb2800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783562424.239898:0:12971:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc7fb2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783562424.239908:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783562424.240627:0:12971:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfcc7fb4000 00000020:02000400:0.0:1783562424.240677:0:12971:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783562424.247901:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562425.270695:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783562425.762945:0:13123:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783562425.772082:0:13123:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1783562425.772173:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562425.772196:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562425.772205:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562425.772213:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562425.772236:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783562425.772241:0:13123:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1783562425.772264:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1783562425.772269:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1783562425.772272:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562425.772280:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499c00 already unused, calling callback (ffffffffc1a65c20) 00000100:00100000:3.0:1783562425.772283:0:13123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcf664b800 x1870200563634560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1783562425.772284:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562425.772301:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562425.772327:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562425.772333:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562425.772335:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783562425.772337:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783562425.772349:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:0.0:1783562425.772353:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562425.772354:0:13123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcf664ad80 x1870200563635072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783562425.772366:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499c00/0x4738ba0933b87df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87dfa expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562425.772377:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562425.772378:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562425.772379:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562425.772387:0:13123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcef1aa300 x1870200563635200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562436 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562425.772430:0:13123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcf6649880 x1870200563635456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562440 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562425.772440:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563634560:0@lo:400:kworker.0 00000100:00100000:3.0:1783562425.772441:0:13123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783562425.772450:0:13123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783562425.772472:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563635456:0@lo:400:kworker.0 00000100:00080000:3.0:1783562425.772479:0:13123:0:(import.c:65:import_set_state_nolock()) ffff9bfcef657800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783562425.772513:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563635584:0@lo:39:umount.0 00000100:00100000:0.0:1783562425.772527:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563635200:0@lo:400:kworker.0 00000400:00000100:1.0:1783562425.772554:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563635584 offset 0 length 224: 4 00000100:00100000:2.0:1783562425.772564:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563635072:0@lo:400:kworker.0 00010000:00010000:0.0:1783562426.295072:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562427.318575:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562428.342589:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783562429.302513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783562429.302524:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783562429.367087:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562430.390926:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562431.415214:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562432.438637:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562433.462666:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783562434.423030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783562434.423039:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783562434.487185:0:8323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562435.510559:0:7446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562435.958544:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562425/real 1783562425] req@ffff9bfcef1a8a80 x1870200563635584/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562435.958579:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcef1a8a80 x1870200563635584/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783562435.958604:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef657800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783562435.958623:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563635584:0@lo:39:umount.0 00000100:00080000:3.0:1783562435.958748:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783562435.958753:0:13123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783562435.958758:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783562435.960194:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960212:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960220:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960227:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960258:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562435.960265:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960290:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960297:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960303:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562435.960334:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783562435.960338:0:13123:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1783562435.960362:0:13123:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1783562435.960367:0:13123:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1783562435.960372:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562435.960382:0:13123:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783562435.960386:0:13123:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9bfcf6b919c0) has no exports 00010000:00010000:1.0:1783562435.960393:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:3.0:1783562435.960444:0:13123:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9bfcf6b919c0) has no exports 00010000:00010000:1.0:1783562435.960459:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960478:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562435.960482:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960491:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562435.960497:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562435.960503:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562435.960506:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1783562435.960508:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783562435.960521:0:5742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:1.0:1783562435.960526:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960533:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336400/0x4738ba0933b87e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87e08 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960546:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562435.960549:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960555:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562435.960558:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960565:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562435.960577:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562435.960582:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783562435.960585:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783562435.960587:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783562435.960594:0:5742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:1.0:1783562435.960596:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562435.960602:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499800/0x4738ba0933b8803f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88046 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562435.960614:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562435.960615:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562435.960617:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562435.960619:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783562435.962584:0:13123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcf69caa80 - data ffff9bfce1f3ae58/ffff9bfcd0f3c400 00000020:01000000:3.0:1783562435.962709:0:13123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfceee7ce40 - data ffff9bfce7584438/ffff9bfcf6f0a800 00100000:10000000:3.0:1783562435.971076:0:13123:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783562435.989705:0:13123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87cf7 00000020:00000080:0.0:1783562435.989717:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfbc6940000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783562435.989728:0:13123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfceec04800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783562435.989743:0:13123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfceec04800 2 00000020:01000004:0.0:1783562435.989746:0:13123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfceec04800 from lustre-OST0001 00000020:00000080:0.0:1783562435.989776:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562435.989822:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6940000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783562435.989862:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783562435.989870:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfbc6941800/lustre-OST0001_UUID 00000020:00000080:0.0:1783562435.989872:0:13123:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6941800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783562435.989879:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783562435.990024:0:13123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a8ed28a5-c620-431b-88b9-f6805bcdc0a6->MGS 00010000:00010000:0.0:1783562435.990081:0:13123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b87bfb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562435.990093:0:13123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b87bfb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562435.990100:0:13123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783562435.990103:0:13123:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783562435.990106:0:13123:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783562435.990120:0:13123:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:0.0:1783562435.990124:0:13123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b87bfb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87c02 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562435.990143:0:13123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562435.990151:0:13123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562435.990162:0:13123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562435.990165:0:13123:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783562435.990166:0:13123:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783562435.990177:0:13123:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcd0119800 00010000:00010000:0.0:1783562435.990181:0:13123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499000/0x4738ba0933b87e47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b87e4e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783562435.990205:0:13123:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0119800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783562435.990208:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783562435.990211:0:13123:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783562435.990212:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783562435.990216:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783562435.990227:0:13123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcf664b480 x1870200563635328/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783562439 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783562435.990307:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783562435.990311:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1783562435.990394:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a8ed28a5-c620-431b-88b9-f6805bcdc0a6:3271:1870200563635328:0@lo:250:kworker.0 10000000:01000000:0.0:1783562435.990633:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783562435.990642:0:13123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87af8 00000020:00000080:0.0:1783562435.990647:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfcd011c800/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 00000020:01000000:0.0:1783562435.990662:0:13123:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.104@tcp (flags='') 00000020:00000080:0.0:1783562435.990668:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783562435.990673:0:13123:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783562435.990677:0:13123:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9bfcc3f199c0) has no exports 10000000:01000000:0.0:1783562435.990697:0:5752:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783562435.990746:0:13123:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.104@tcp: client import never connected 00000100:00080000:0.0:1783562435.990749:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783562435.990750:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783562435.990752:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783562435.990754:0:13123:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783562435.990782:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562435.990786:0:13123:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.104@tcp (uuid a8ed28a5-c620-431b-88b9-f6805bcdc0a6) 00000020:01000000:0.0:1783562435.990791:0:13123:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783562435.990794:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783562435.990798:0:13123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783562435.990802:0:13123:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bfcef650000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783562435.990807:0:13123:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9bfcef6499c0) has exports, disconnecting them 00000020:00080000:0.0:1783562435.990811:0:13123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bfcef650000), last request at 1783562294 00000020:00000080:0.0:1783562435.990822:0:13123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87d21 00000020:00080000:0.0:1783562435.990832:0:13123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcef650000): rc 0 00000020:00000080:0.0:1783562435.990836:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfcef650000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783562435.991592:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd011c800/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 for MGC192.168.204.104@tcp 00000020:00000080:3.0:1783562435.991618:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef650000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783562435.991980:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcd0119800 for MGC192.168.204.104@tcp 00000020:00000080:3.0:1783562435.991988:0:8:0:(genops.c:906:class_export_put()) final put ffff9bfcd011f000/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 00000020:00000080:3.0:1783562435.991990:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd011f000/a8ed28a5-c620-431b-88b9-f6805bcdc0a6 for MGC192.168.204.104@tcp 00000020:01000000:3.0:1783562435.991995:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.104@tcp (a8ed28a5-c620-431b-88b9-f6805bcdc0a6) 00010000:01000000:2.0:1783562435.992539:0:13123:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783562435.992544:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562435.992548:0:13123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783562435.992554:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562435.992639:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef657800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1783562435.992652:0:8323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783562435.992816:0:7446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783562435.992921:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1783562435.993009:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1783562435.993104:0:5737:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bfcc5c8b800:5737] 0 exiting: rc = 1 00000100:00100000:2.0:1783562435.993131:0:5738:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bfcd812d200:5738] 1 exiting: rc = 0 00000100:00100000:2.0:1783562435.993191:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562435.993493:0:11471:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9bfcd812a800:11471] 4 exiting: rc = 0 00000100:00100000:3.0:1783562435.993541:0:7447:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bfceee3f800:7447] 3 exiting: rc = 0 00000100:00100000:2.0:1783562435.993599:0:5741:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bfcd0112200:5741] 2 exiting: rc = 0 00000100:00100000:2.0:1783562435.993664:0:5739:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bfcd0f15200:5739] 0 exiting: rc = 1 00000100:00100000:1.0:1783562435.993734:0:5740:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bfcc5193000:5740] 1 exiting: rc = 0 00000100:00100000:3.0:1783562435.993816:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993827:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993838:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993844:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993855:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993862:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993867:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993883:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993899:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993906:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993912:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993918:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993924:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993930:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993935:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993942:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993949:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993955:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993961:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993967:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993973:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993978:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993983:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993989:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.993994:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994000:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994005:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994015:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994024:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994045:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994050:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994056:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994061:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994066:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994071:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994076:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994082:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994087:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994092:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994102:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994107:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994113:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994118:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994123:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994128:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994133:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994137:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994142:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994147:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994156:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994161:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994167:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994172:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994177:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994181:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994186:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994191:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994195:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994199:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994204:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994208:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994213:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994218:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562435.994223:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783562435.995133:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562435.995145:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783562435.995157:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfcef6a3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783562435.995162:0:13123:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef6a3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783562435.995175:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1783562435.995230:0:13123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfceec04800 1 00000020:00000080:3.0:1783562435.995236:0:13123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b87cc6 00000020:00000080:3.0:1783562435.995242:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfcf6162800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783562435.995255:0:13123:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783562435.995258:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562435.995263:0:13123:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1783562435.995270:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6162800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:3.0:1783562435.995272:0:13123:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9bfcf712cd40) has no exports 00000020:00000080:0.0:1783562436.010362:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562436.010378:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783562436.010383:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfceec04000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783562436.010388:0:13123:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfceec04000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783562436.010398:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783562436.010696:0:13123:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfceec00000 00000020:01000000:0.0:1783562436.010726:0:13123:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783562436.010731:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783562436.010740:0:13123:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783562436.010744:0:13123:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9bfcc5cf99c0) has no exports 00000020:00000080:0.0:1783562436.010773:0:13123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562436.010789:0:13123:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783562436.010793:0:13123:0:(genops.c:906:class_export_put()) final put ffff9bfced842800/OSS_uuid 00000020:00000080:0.0:1783562436.010796:0:13123:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfced842800/OSS_uuid for OSS 00000020:01000000:0.0:1783562436.010800:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1783562436.010868:0:5751:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1783562436.010952:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bfceed24600:6608] 3 exiting: rc = 0 00000100:00100000:2.0:1783562436.011033:0:6547:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bfcc7ee5a00:6547] 0 exiting: rc = 1 00000100:00100000:0.0:1783562436.012511:0:6550:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bfceed36400:6550] 2 exiting: rc = 0 00000100:00100000:3.0:1783562436.012877:0:6549:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bfceed36e00:6549] 1 exiting: rc = 0 00000100:00100000:0.0:1783562436.013642:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013667:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013685:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013696:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013703:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013710:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013718:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013725:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013732:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013752:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013762:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013769:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013776:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013782:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013809:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013817:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013825:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013832:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013840:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013847:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013854:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013861:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013868:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013874:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013881:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013887:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013911:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013919:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013925:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013932:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013940:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013946:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013954:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013960:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013968:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013975:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013981:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013988:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.013995:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014002:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014026:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014036:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014043:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014050:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014056:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014064:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014071:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014077:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014083:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014101:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014107:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014112:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014118:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014123:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014131:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014140:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014149:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014159:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014169:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014180:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014187:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014194:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014201:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.014210:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562436.015220:0:6551:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bfceed37a00:6551] 0 exiting: rc = 1 00000100:00100000:3.0:1783562436.015255:0:8024:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bfcf6738e00:8024] 2 exiting: rc = 0 00000100:00100000:1.0:1783562436.015265:0:6552:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bfcd812c400:6552] 1 exiting: rc = 0 00000100:00100000:0.0:1783562436.015594:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015604:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015611:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015617:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015624:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015630:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015637:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015643:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015649:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015656:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015679:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015688:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015694:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015701:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015707:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015713:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015720:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015727:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015733:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015739:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015765:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015771:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015778:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015785:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015793:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015801:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015808:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015814:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015821:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015827:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015834:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015841:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015847:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015853:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015860:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015866:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015873:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015879:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015885:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015905:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015913:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015921:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015928:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015937:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015946:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015953:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015961:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015968:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015975:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015983:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015991:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.015998:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016091:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016104:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016109:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016122:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016128:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016134:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016141:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016147:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016153:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016160:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016167:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.016174:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562436.018804:0:6555:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bfceed37400:6555] 2 exiting: rc = 0 00000100:00100000:2.0:1783562436.019331:0:6554:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bfceed36000:6554] 1 exiting: rc = 0 00000100:00100000:3.0:1783562436.019368:0:6553:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bfcd812ce00:6553] 0 exiting: rc = 1 00000100:00100000:0.0:1783562436.019497:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019508:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019516:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019523:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019530:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019537:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019545:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019551:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019559:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019566:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019573:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019580:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019587:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019594:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019614:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019623:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019631:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019637:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019645:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019651:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019657:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019665:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019673:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019680:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019686:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019784:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019817:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019825:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019832:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019839:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019846:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019854:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019861:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019868:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019876:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019883:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019902:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019921:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019966:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019975:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019982:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019990:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.019997:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020004:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020010:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020018:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020026:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020033:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020040:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020046:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020054:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020060:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020067:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020074:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020082:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020088:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020096:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020102:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020114:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020121:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020128:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020148:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020155:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.020162:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562436.025236:0:6556:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bfceed36800:6556] 0 exiting: rc = 1 00000100:00100000:3.0:1783562436.025347:0:6557:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bfcf6844a00:6557] 1 exiting: rc = 0 00000100:00100000:0.0:1783562436.026031:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026041:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026048:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026056:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026063:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026070:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026078:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026085:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026092:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026098:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026103:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026109:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026115:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026120:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026125:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026133:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026140:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026145:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026153:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026158:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026165:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026172:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026179:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026185:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026192:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026199:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026206:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026212:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026219:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026226:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026233:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026240:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026262:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026269:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026276:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026282:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026289:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026296:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026302:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026310:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026316:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026323:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026329:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026337:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026344:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026350:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026358:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026365:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026371:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026378:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026384:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026391:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026398:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026534:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026542:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026549:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026557:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026564:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026570:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026577:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026584:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026591:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026598:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.026614:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562436.027716:0:6558:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bfcc5192e00:6558] 0 exiting: rc = 1 00000100:00100000:2.0:1783562436.027875:0:6559:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bfbc227e000:6559] 1 exiting: rc = 0 00000100:00100000:0.0:1783562436.027969:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.027979:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028000:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028027:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028036:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028043:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028051:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028072:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028083:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028090:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028097:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028104:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028109:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028115:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028121:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028127:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028134:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028141:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028149:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028180:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028191:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028198:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028207:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028215:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028222:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028230:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028237:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028245:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028252:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028260:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028268:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028299:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028311:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028319:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028326:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028333:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028340:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028350:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028369:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028377:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028384:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028393:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028435:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028472:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028484:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028492:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028501:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028509:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028516:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028525:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028532:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028540:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028548:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028556:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028563:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028591:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028602:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028610:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028618:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028625:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028644:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028655:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028662:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562436.028669:0:13123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783562436.043995:0:13123:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783562444.206657:0:13739:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783562447.908236:0:14151:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783562447.908242:0:14151:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783562447.908358:0:14151:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfcf6881000 00000020:01000004:0.0:1783562447.908378:0:14151:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783562447.908387:0:14151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783562447.908439:0:14151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bfcc3f199c0) 00000020:00000080:0.0:1783562447.908456:0:14151:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783562447.919082:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783562447.920806:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783562447.921151:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1783562447.921237:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1783562447.921328:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783562447.921392:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1783562447.921488:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1783562447.921682:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783562447.921741:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1783562447.921988:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1783562447.922941:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1783562447.923038:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:0.0:1783562447.923484:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:0.0:1783562447.923707:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:0.0:1783562447.924080:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.924323:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.924629:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.924950:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:0.0:1783562447.925196:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 591: rc = 0 00100000:10000000:0.0:1783562447.925450:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.925692:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.925947:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562447.926187:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 591: rc = 0 00100000:10000000:0.0:1783562447.926494:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 591: rc = 0 00100000:10000000:0.0:1783562447.927045:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 610: rc = 0 00100000:10000000:0.0:1783562447.927309:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 610: rc = 0 00100000:10000000:0.0:1783562447.927575:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 610: rc = 0 00100000:10000000:0.0:1783562447.927791:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 610: rc = 0 00100000:10000000:0.0:1783562447.928053:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 610: rc = 0 00100000:10000000:0.0:1783562447.928314:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 610: rc = 0 00100000:10000000:0.0:1783562447.928694:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 610: rc = 0 00100000:10000000:0.0:1783562447.928944:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 610: rc = 0 00100000:10000000:0.0:1783562447.929184:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 610: rc = 0 00100000:10000000:0.0:1783562447.929482:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 610: rc = 0 00100000:10000000:0.0:1783562447.929746:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 610: rc = 0 00100000:10000000:0.0:1783562447.929983:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 610: rc = 0 00100000:10000000:0.0:1783562447.930216:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 610: rc = 0 00100000:10000000:0.0:1783562447.930516:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 610: rc = 0 00100000:10000000:0.0:1783562447.930774:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 610: rc = 0 00100000:10000000:0.0:1783562447.931084:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 610: rc = 0 00100000:10000000:0.0:1783562447.931327:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 610: rc = 0 00100000:10000000:0.0:1783562447.931625:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 610: rc = 0 00100000:10000000:0.0:1783562447.931937:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 610: rc = 0 00100000:10000000:0.0:1783562447.932175:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 610: rc = 0 00100000:10000000:0.0:1783562447.932452:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 610: rc = 0 00100000:10000000:0.0:1783562447.932711:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 610: rc = 0 00100000:10000000:0.0:1783562447.932981:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 610: rc = 0 00100000:10000000:0.0:1783562447.933198:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 610: rc = 0 00100000:10000000:0.0:1783562447.933425:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 610: rc = 0 00100000:10000000:0.0:1783562447.933654:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 610: rc = 0 00100000:10000000:0.0:1783562447.933856:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 610: rc = 0 00100000:10000000:0.0:1783562447.934052:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 610: rc = 0 00100000:10000000:0.0:1783562447.934303:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 610: rc = 0 00100000:10000000:0.0:1783562447.934608:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 610: rc = 0 00100000:10000000:0.0:1783562447.934950:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 610: rc = 0 00100000:10000000:0.0:1783562447.935171:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 610: rc = 0 00100000:10000000:0.0:1783562447.935520:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 599: rc = 0 00100000:10000000:0.0:1783562447.935991:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1783562447.936156:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:0.0:1783562447.936347:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1783562447.936514:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:0.0:1783562447.936741:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1783562447.936803:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:0.0:1783562447.937156:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1783562447.937219:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:0.0:1783562447.937451:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1783562447.937542:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:0.0:1783562447.937744:0:14151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1783562447.937806:0:14151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00000020:00000080:0.0:1783562447.938122:0:14151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783562447.938137:0:14151:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783562447.938150:0:14151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88df2 00000020:01000004:0.0:1783562447.938160:0:14151:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1783562447.938166:0:14151:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783562447.938172:0:14151:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfcf6881000 from MGS 00000020:01000004:0.0:1783562447.938175:0:14151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783562447.938186:0:14151:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bfcc3f18000) 00000020:00000080:0.0:1783562447.938197:0:14151:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783562447.938261:0:14151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6881000 from MGS, refs=2 00080000:01000000:0.0:1783562447.938266:0:14151:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783562447.938272:0:14151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88e00 00000100:00100000:0.0:1783562447.938386:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783562447.938622:0:14151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783562447.938629:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783562447.939346:0:14151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783562447.939355:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1783562447.939969:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783562447.940121:0:14151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1783562447.940127:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783562447.940596:0:14151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783562447.940603:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783562447.940816:0:14151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783562447.940822:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783562447.941448:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562447.941451:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562447.941453:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562447.941798:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562447.941806:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562447.941808:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562447.942233:0:14151:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783562447.944535:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783562447.949252:0:14151:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783562447.949266:0:14151:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783562447.949268:0:14151:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1783562447.950532:0:14160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783562447.950648:0:14151:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783562447.950794:0:14151:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783562447.951365:0:14151:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783562447.951910:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562447.952197:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783562447.952215:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783562447.953247:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783562447.953261:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783562447.955177:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783562447.955203:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1783562447.958055:0:14165:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1783562447.958299:0:14151:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783562447.958322:0:14151:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.104@tcp' 00000020:01000004:3.0:1783562447.958324:0:14151:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783562447.958355:0:14151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.104@tcp (typ=mgc) 00000020:00000080:3.0:1783562447.958368:0:14151:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.104@tcp (ffff9bfcf6b90000) 00000020:00000080:3.0:1783562447.958385:0:14151:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783562447.958595:0:14151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcef1db800@MGC192.168.204.104@tcp: add connection 192.168.204.104@tcp at head 00010000:00010000:3.0:1783562447.958764:0:14151:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.104@tcp-0 is initialized 00000040:01000000:3.0:1783562447.958771:0:14151:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783562447.959159:0:14166:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783562447.959251:0:14151:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.104@tcp (uuid e84b51d8-00f8-4fc5-9608-af3d9dda1905) 00000020:00000080:3.0:1783562447.959269:0:14151:0:(genops.c:1406:class_connect()) connect: client e84b51d8-00f8-4fc5-9608-af3d9dda1905, cookie 0x4738ba0933b88e0e 00000100:00080000:3.0:1783562447.959280:0:14151:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562447.959286:0:14151:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcef1db800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562447.959321:0:14151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef1a9c00 x1870200563635712/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783562447.959382:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563635712:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783562447.959511:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783562447.959593:0:14151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS 00000020:01000004:3.0:1783562447.959615:0:14151:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783562447.959641:0:14151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783562447.959654:0:14151:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bfcf6b94d40) 00000020:00000080:3.0:1783562447.959676:0:14151:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783562447.960217:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563635712 00000100:00100000:1.0:1783562447.960237:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563635712 00000100:00100000:1.0:1783562447.960305:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562447.960320:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3271:x1870200563635712:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783562447.960378:0:14161:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e84b51d8-00f8-4fc5-9608-af3d9dda1905@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1783562447.960454:0:14161:0:(genops.c:1406:class_connect()) connect: client e84b51d8-00f8-4fc5-9608-af3d9dda1905, cookie 0x4738ba0933b88e1c 00000100:00080000:1.0:1783562447.960762:0:14161:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7fb4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562447.960918:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+5:3271:x1870200563635712:12345-0@lo:250:mount.lustre.0 Request processed in 599us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562447.960931:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562447.960951:0:3271:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783562447.960965:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1783562447.960977:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783562447.960985:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783562447.961000:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783562447.961004:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783562447.961016:0:3271:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783562447.961025:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563635712:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783562447.966369:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562447.966659:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562447.966678:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783562447.967679:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783562447.967776:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783562447.968151:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783562447.968159:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783562447.968940:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562447.969115:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783562447.969121:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783562447.970218:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783562447.970232:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783562447.996396:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562447.996895:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783562447.996904:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783562447.998109:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783562447.998118:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783562447.999000:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562447.999186:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783562447.999191:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783562447.999795:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783562447.999803:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783562448.000831:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562448.000995:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783562448.001007:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783562448.001862:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783562448.001870:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783562448.002920:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562448.003058:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783562448.003063:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783562448.005499:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783562448.005512:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783562448.020455:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562448.020656:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562448.020674:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783562448.021655:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783562448.021674:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783562448.022324:0:14151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783562448.022333:0:14151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783562448.023074:0:14151:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783562448.023104:0:14151:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783562448.023115:0:14151:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783562448.023301:0:14151:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783562448.023336:0:14151:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783562448.023339:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783562448.023341:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562448.023342:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562448.023343:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562448.023344:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562448.023345:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562448.023346:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562448.023347:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562448.023348:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562448.023352:0:14151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783562448.023354:0:14151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783562448.023355:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783562448.023356:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783562448.023357:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562448.023357:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562448.023358:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562448.023359:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562448.023359:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783562448.023360:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783562448.023360:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562448.023361:0:14151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783562448.023438:0:14151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783562448.023460:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9296a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563635840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783562448.023536:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562448.023584:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd358ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.023627:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563635840 00000100:00100000:1.0:1783562448.023637:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563635840 00000100:00100000:1.0:1783562448.023701:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562448.023712:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+5:14151:x1870200563635840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783562448.023770:0:14164:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783562448.023773:0:14164:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783562448.023777:0:14164:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1783562448.024023:0:14185:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783562448.024331:0:14164:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783562448.025260:0:14186:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783562448.025265:0:14186:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783562448.025267:0:14186:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783562448.025291:0:14186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783562448.025464:0:14164:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783562448.025474:0:14164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783562448.032933:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+5:14151:x1870200563635840:12345-0@lo:253:mount.lustre.0 Request processed in 9209us (9382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562448.032970:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562448.033116:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9296a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563635840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783562448.033135:0:14151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783562448.033138:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783562448.033140:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783562448.033141:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562448.033142:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562448.033144:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562448.033145:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562448.033146:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783562448.033148:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783562448.033150:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562448.033151:0:14151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783562448.033175:0:14151:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfcf6881000 from lustre-MDT0000 10000000:01000000:3.0:1783562448.033214:0:14151:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783562448.033218:0:14151:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783562448.033223:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bfcf6b90000 10000000:01000000:3.0:1783562448.033227:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562448.033237:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfcf6b90000 from 1 10000000:01000000:3.0:1783562448.033240:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783562448.033286:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.033298:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.033330:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.033356:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563635968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562448.033394:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.033489:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563635968 00000100:00100000:1.0:1783562448.033498:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563635968 00000100:00100000:3.0:1783562448.033512:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.033542:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562448.033550:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+5:14151:x1870200563635968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.033560:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562448.033577:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b88e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88e23 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.033596:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b88e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88e23 expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.033604:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b88e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88e23 expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.033612:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682600, rc 0) 00000100:00100000:1.0:1783562448.033638:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+6:14151:x1870200563635968:12345-0@lo:101:mount.lustre.0 Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.033643:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562448.033689:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563635968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562448.033703:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.033712:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.033757:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562448.033782:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.033841:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562448.033880:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636096 00000100:00100000:0.0:1783562448.033884:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636096 00000100:00100000:0.0:1783562448.033911:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562448.033918:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+6:14151:x1870200563636096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562448.034265:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+6:14151:x1870200563636096:12345-0@lo:501:mount.lustre.0 Request processed in 346us (480us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783562448.034272:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562448.034330:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783562448.034354:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783562448.034369:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.034378:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562448.034387:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcf6881000 10000000:01000000:3.0:1783562448.034391:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783562448.034467:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bfcf6881000 10000000:01000000:3.0:1783562448.034471:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783562448.034474:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9bfcf6881000 from 1 10000000:01000000:3.0:1783562448.034477:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783562448.034495:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.034503:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.034511:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.034524:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562448.034549:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.034577:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.034599:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636224 00000100:00100000:1.0:1783562448.034605:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636224 00000100:00100000:1.0:1783562448.034683:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562448.034691:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+6:14151:x1870200563636224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.034699:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562448.034710:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682c00/0x4738ba0933b88e38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88e31 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.034724:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682c00/0x4738ba0933b88e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88e31 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.034732:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682c00/0x4738ba0933b88e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88e31 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.034739:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682c00, rc 0) 00000100:00100000:1.0:1783562448.034770:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+7:14151:x1870200563636224:12345-0@lo:101:mount.lustre.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.034785:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562448.034809:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562448.034820:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.034829:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562448.034840:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783562448.034898:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.034907:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562448.034924:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783562448.034928:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562448.034933:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bfcf6881000 10000000:01000000:3.0:1783562448.034935:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783562448.035010:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783562448.035014:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562448.035028:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.035035:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.035042:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.035055:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562448.035080:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.035099:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.035161:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636352 00000100:00100000:1.0:1783562448.035166:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636352 00000100:00100000:1.0:1783562448.035205:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783562448.035215:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+7:14151:x1870200563636352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.035223:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562448.035234:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682400/0x4738ba0933b88e46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88e3f expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.035250:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682400/0x4738ba0933b88e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88e3f expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.035260:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682400/0x4738ba0933b88e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88e3f expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.035266:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682400, rc 0) 00000100:00100000:1.0:1783562448.035371:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+8:14151:x1870200563636352:12345-0@lo:101:mount.lustre.0 Request processed in 158us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.035378:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562448.036172:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562448.036203:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.036216:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562448.036313:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562448.036379:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.036463:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636480 00000100:00100000:2.0:1783562448.036469:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5a02f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.036477:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636480 00000100:00100000:1.0:1783562448.036602:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783562448.036613:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+8:14151:x1870200563636480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562448.037366:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14151:x1870200563636480:12345-0@lo:501:mount.lustre.0 Request processed in 754us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.037375:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562448.037434:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562448.037489:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562448.037525:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562448.037551:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5a02f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.037943:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636608 00000100:00100000:1.0:1783562448.037954:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636608 00000100:00100000:1.0:1783562448.037990:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562448.038065:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14151:x1870200563636608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562448.038368:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14151:x1870200563636608:12345-0@lo:503:mount.lustre.0 Request processed in 370us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.038375:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562448.038774:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563636608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562448.039130:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14187:1870200563636736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562448.039171:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562448.039202:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5a02a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.039540:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563636736 00000100:00100000:1.0:1783562448.039545:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563636736 00000100:00100000:1.0:1783562448.039597:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562448.039603:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14187:x1870200563636736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562448.039894:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14187:x1870200563636736:12345-0@lo:502:llog_process_th.0 Request processed in 289us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.039902:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562448.039992:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14187:1870200563636736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562448.040019:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562448.040029:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562448.040032:0:14187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783562448.040037:0:14187:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783562448.040040:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783562448.040055:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bfcc3f1b380) 00000020:00000080:0.0:1783562448.040077:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783562448.040083:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783562448.040147:0:14187:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783562448.040155:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88e54 00000020:00000080:0.0:1783562448.040371:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783562448.040377:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562448.040381:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562448.040382:0:14187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783562448.040385:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562448.040389:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562448.040395:0:14187:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783562448.040399:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783562448.040453:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bfcc3f1cd40) 00000020:00000080:0.0:1783562448.040466:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783562448.040471:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783562448.040473:0:14187:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783562448.040476:0:14187:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783562448.040482:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783562448.040532:0:14187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6881000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783562448.040553:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bfcc5043380) 00000020:00000080:0.0:1783562448.040563:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783562448.040605:0:14187:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783562448.040610:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b88e69 00000020:00000080:0.0:1783562448.040710:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783562448.040716:0:14187:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783562448.040721:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4738ba0933b88e70 00080000:01000000:0.0:1783562448.040726:0:14187:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783562448.040729:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88e77 00010000:00010000:0.0:1783562448.082793:0:14187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1783562448.083212:0:14187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1783562448.083542:0:14187:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783562448.083947:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bfcc50419c0) 00000020:00000080:0.0:1783562448.083963:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783562448.084010:0:14187:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783562448.084016:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88e85 00000020:00000080:1.0:1783562448.084597:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783562448.088137:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4738ba0933b88e8c 00000020:00000080:1.0:1783562448.088591:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783562448.088613:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.088620:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.088622:0:14187:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783562448.088627:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783562448.088630:0:14187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783562448.088632:0:14187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562448.088634:0:14187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562448.088636:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783562448.088639:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.088641:0:14187:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783562448.088644:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562448.088651:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.088653:0:14187:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783562448.088658:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783562448.088718:0:14187:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783562448.088734:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.088737:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.088738:0:14187:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783562448.088741:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562448.088745:0:14187:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783562448.088748:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.088750:0:14187:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783562448.088753:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783562448.088759:0:14187:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:1.0:1783562448.088793:0:14187:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783562448.088796:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562448.088813:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bfcef64cd40) 00000020:00000080:1.0:1783562448.088826:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783562448.088831:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783562448.088899:0:14187:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783562448.088908:0:14187:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783562448.088916:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88e9a 00010000:00080000:1.0:1783562448.088951:0:14187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcc6403000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562448.089162:0:14187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1783562448.089510:0:14187:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783562448.089553:0:14187:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783562448.090471:0:14187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562448.090545:0:14187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783562448.090628:0:14187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783562448.090979:0:14191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783562448.090985:0:14191:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783562448.091424:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562448.091438:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783562448.091467:0:14187:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783562448.091483:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b88ea1 00000100:00080000:1.0:1783562448.091491:0:14187:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562448.091495:0:14187:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bfcc6403000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562448.091531:0:14187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9af100 x1870200563636864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562448.091551:0:14187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1783562448.091604:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563636864:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1783562448.091655:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.091659:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.091671:0:14187:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783562448.091675:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783562448.091677:0:14187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783562448.091678:0:14187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562448.091680:0:14187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000400:00000100:2.0:1783562448.091681:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870200563636864 offset 0 length 520: 4 00000020:01000000:1.0:1783562448.091681:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783562448.091684:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.091685:0:14187:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783562448.091687:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562448.091691:0:14187:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783562448.091693:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.091695:0:14187:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783562448.091697:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783562448.091700:0:14187:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:1.0:1783562448.091718:0:14187:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783562448.091720:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562448.091730:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bfcef64b380) 00000020:00000080:1.0:1783562448.091742:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1783562448.091746:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783562448.091808:0:14187:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783562448.091812:0:14187:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783562448.091816:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b88eaf 00010000:00080000:1.0:1783562448.091847:0:14187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcd0d32800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562448.092011:0:14187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1783562448.092162:0:14187:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783562448.092177:0:14187:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783562448.092351:0:14187:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:1.0:1783562448.092703:0:14187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562448.092780:0:14187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783562448.092843:0:14187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783562448.093462:0:14193:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1783562448.093468:0:14193:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783562448.094198:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562448.094213:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783562448.094243:0:14187:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783562448.094263:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b88eb6 00000100:00080000:1.0:1783562448.094272:0:14187:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562448.094277:0:14187:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcd0d32800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562448.094316:0:14187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9ac000 x1870200563636992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783562448.094373:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563636992:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783562448.094460:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870200563636992 offset 0 length 520: 4 00000100:00080000:1.0:1783562448.094548:0:14187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783562448.094609:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.094613:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.094616:0:14187:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783562448.094618:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562448.094623:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.094624:0:14187:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783562448.094627:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783562448.094629:0:14187:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783562448.094631:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.094633:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.094634:0:14187:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783562448.094636:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562448.094638:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.094639:0:14187:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783562448.094643:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783562448.094683:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14187:1870200563637120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562448.094741:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.094769:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562448.094792:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637120 00000100:00100000:0.0:1783562448.094800:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637120 00000100:00100000:0.0:1783562448.094852:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783562448.094858:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14187:x1870200563637120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562448.095045:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14187:x1870200563637120:12345-0@lo:502:llog_process_th.0 Request processed in 186us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562448.095061:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783562448.095075:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14187:1870200563637120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783562448.095098:0:14187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562448.095101:0:14187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562448.095103:0:14187:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783562448.095106:0:14187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1783562448.095163:0:14151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1783562448.095188:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783562448.095205:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.095213:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562448.095227:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcf6881000 from 1 10000000:01000000:3.0:1783562448.095229:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783562448.095249:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.095254:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.095260:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.095270:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562448.095291:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.095308:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.095328:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637248 00000100:00100000:1.0:1783562448.095333:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637248 00000100:00100000:1.0:1783562448.095395:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783562448.095421:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+9:14151:x1870200563637248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.095430:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562448.095445:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88ebd expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.095467:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.095479:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.095489:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683e00, rc 0) 00000100:00100000:1.0:1783562448.095523:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+10:14151:x1870200563637248:12345-0@lo:101:mount.lustre.0 Request processed in 121us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.095531:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562448.095541:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562448.095553:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.095560:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562448.096232:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637376:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783562448.096260:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.096281:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6dc8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562448.096355:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637376 00000100:00100000:2.0:1783562448.096359:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637376 00000100:00100000:2.0:1783562448.096447:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783562448.096456:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+10:14151:x1870200563637376:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783562448.096472:0:14161:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783562448.096479:0:14161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783562448.096559:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+10:14151:x1870200563637376:12345-0@lo:256:mount.lustre.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562448.096564:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562448.096581:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637376:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783562448.097083:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783562448.097127:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.097143:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562448.097149:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6881000 from 1 10000000:01000000:1.0:1783562448.097150:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562448.097167:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.097172:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.097178:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562448.097190:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562448.097219:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.097249:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562448.097260:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637504 00000100:00100000:2.0:1783562448.097264:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637504 00000100:00100000:2.0:1783562448.097296:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783562448.097319:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+10:14151:x1870200563637504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562448.097328:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562448.097340:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88ecb expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.097356:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.097365:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.097373:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1da00, rc 0) 00000100:00100000:1.0:1783562448.097477:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.097489:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.097496:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562448.097538:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562448.097561:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.097583:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.097593:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637632 00000100:00100000:3.0:1783562448.097598:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637632 00000100:00100000:3.0:1783562448.097623:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562448.097633:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563637632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562448.097699:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563637504:12345-0@lo:101:mount.lustre.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562448.097706:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562448.098001:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14151:x1870200563637632:12345-0@lo:501:mount.lustre.0 Request processed in 367us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.098009:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562448.098031:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562448.098057:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562448.098088:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.098135:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562448.098159:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637760 00000100:00100000:0.0:1783562448.098162:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637760 00000100:00100000:0.0:1783562448.098185:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783562448.098192:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14151:x1870200563637760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562448.098380:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14151:x1870200563637760:12345-0@lo:503:mount.lustre.0 Request processed in 189us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562448.098385:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783562448.098480:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563637760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562448.098806:0:14195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14195:1870200563637888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562448.098851:0:14195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562448.098879:0:14195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.098881:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563637888 00000100:00100000:3.0:1783562448.098886:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563637888 00000100:00100000:3.0:1783562448.098907:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783562448.098912:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14195:x1870200563637888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562448.099043:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14195:x1870200563637888:12345-0@lo:502:llog_process_th.0 Request processed in 130us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.099047:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783562448.099111:0:14195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14195:1870200563637888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562448.099131:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562448.099140:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.099143:0:14195:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783562448.099150:0:14195:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6881000 00000020:00000080:2.0:1783562448.099152:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562448.099158:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562448.099159:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.099160:0:14195:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783562448.099162:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562448.099163:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.099168:0:14195:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783562448.099170:0:14195:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6881000 00000020:00000080:2.0:1783562448.099171:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562448.099262:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562448.099266:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.099268:0:14195:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783562448.099270:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562448.099273:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.099274:0:14195:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783562448.099277:0:14195:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcf6881000 00000020:00000080:2.0:1783562448.099279:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783562448.101266:0:14195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14195:1870200563638016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783562448.101344:0:14195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.101395:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638016 00000100:00100000:2.0:1783562448.101399:0:14195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.101422:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638016 00000100:00100000:1.0:1783562448.101473:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562448.101480:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14195:x1870200563638016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562448.101732:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14195:x1870200563638016:12345-0@lo:502:llog_process_th.0 Request processed in 251us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.101741:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783562448.102058:0:14195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14195:1870200563638016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783562448.102092:0:14195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562448.102100:0:14195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562448.102102:0:14195:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783562448.102106:0:14195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783562448.102622:0:14151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783562448.102640:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562448.102659:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.102679:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562448.102720:0:14151:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783562448.102723:0:14151:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcf6881000 10000000:01000000:1.0:1783562448.102726:0:14151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcf6881000 10000000:01000000:1.0:1783562448.102730:0:14151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783562448.102736:0:14151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcf6881000 from 1 10000000:01000000:1.0:1783562448.102739:0:14151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562448.103246:0:14151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.103264:0:14151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.103275:0:14151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562448.103296:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562448.103350:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.103387:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.103396:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638144 00000100:00100000:3.0:1783562448.103423:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638144 00000100:00100000:3.0:1783562448.103464:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783562448.103474:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14151:x1870200563638144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562448.103485:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562448.103499:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337200/0x4738ba0933b88ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88ed9 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.103522:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337200/0x4738ba0933b88ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88ed9 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.103533:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337200/0x4738ba0933b88ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88ed9 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562448.103542:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337200, rc 0) 00000100:00100000:3.0:1783562448.103584:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638144:12345-0@lo:101:mount.lustre.0 Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.103596:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783562448.103613:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562448.103629:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.103650:0:14151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562448.103718:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562448.103751:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.103777:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.103791:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638272 00000100:00100000:3.0:1783562448.103796:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638272 00000100:00100000:3.0:1783562448.103822:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783562448.103829:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562448.105896:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638272:12345-0@lo:501:mount.lustre.0 Request processed in 2059us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.105908:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783562448.105999:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562448.106047:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562448.106101:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.106158:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.106191:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638400 00000100:00100000:3.0:1783562448.106196:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638400 00000100:00100000:3.0:1783562448.106261:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783562448.106269:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562448.106576:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638400:12345-0@lo:503:mount.lustre.0 Request processed in 306us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.106583:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562448.106674:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562448.106962:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14199:1870200563638528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562448.107008:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562448.107069:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219f000 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.107105:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638528 00000100:00100000:1.0:1783562448.107115:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638528 00000100:00100000:1.0:1783562448.107175:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783562448.107183:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14199:x1870200563638528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562448.107379:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14199:x1870200563638528:12345-0@lo:502:llog_process_th.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.107387:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783562448.107695:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14199:1870200563638528:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783562448.107757:0:14199:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783562448.107772:0:14199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bfcf6b93380) 00000020:00000080:3.0:1783562448.107792:0:14199:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1783562448.109733:0:14199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6881000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783562448.109747:0:14199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6881000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783562448.109751:0:14199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6881000 4 00010000:00080000:3.0:1783562448.109797:0:14199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcc3ecf000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:3.0:1783562448.112336:0:14199:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1783562448.112521:0:14199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783562448.112573:0:14199:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783562448.112587:0:14199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4738ba0933b88eee 00000100:00080000:3.0:1783562448.112599:0:14199:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562448.112606:0:14199:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bfcc3ecf000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562448.112869:0:14199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef1ab480 x1870200563638656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783562448.112898:0:14199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783562448.112942:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563638656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783562448.113008:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562448.113072:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638656 00000100:00100000:0.0:1783562448.113076:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638656 00000100:00100000:0.0:1783562448.113107:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562448.113113:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563638656:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783562448.113163:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563638656:12345-0@lo:38:llog_process_th.0 Request processed in 49us (153us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783562448.113170:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14199:1870200563638784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562448.113177:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562448.113229:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562448.113232:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562448.113240:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ecf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562448.113245:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783562448.113250:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563638656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783562448.113252:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562448.113276:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638784 00000100:00100000:3.0:1783562448.113282:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638784 00000100:00100000:3.0:1783562448.113323:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783562448.113333:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14199:x1870200563638784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562448.113623:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14199:x1870200563638784:12345-0@lo:502:llog_process_th.0 Request processed in 292us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562448.113631:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783562448.114630:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14199:1870200563638784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783562448.114676:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783562448.114772:0:14151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783562448.114797:0:14151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562448.114825:0:14151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.114837:0:14151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783562448.114885:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783562448.114888:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562448.114889:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562448.114890:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562448.114892:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562448.114893:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562448.114894:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562448.114895:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562448.114897:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562448.114898:0:14151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562448.114902:0:14151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783562448.114904:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783562448.114905:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562448.114906:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562448.114907:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562448.114908:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562448.114909:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562448.114910:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562448.114911:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562448.114912:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562448.114918:0:14151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562448.114936:0:14151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783562448.114966:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562448.115016:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.115066:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1783562448.115086:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563638912 00000100:00100000:1.0:1783562448.115091:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563638912 00000100:00100000:1.0:1783562448.115141:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783562448.115164:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14151:x1870200563638912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783562448.115201:0:14163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783562448.115217:0:14163:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783562448.134917:0:14163:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783562448.134937:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783562448.135013:0:14185:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783562448.135020:0:14185:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783562448.135053:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.135076:0:14185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.135086:0:14185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.135148:0:14185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.135166:0:14185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 12 pid: 14163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562448.135184:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563639040:0@lo:104: 00000100:00100000:2.0:1783562448.135274:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562448.135334:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562448.135346:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639040 00000100:00100000:0.0:1783562448.135372:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639040 00000100:00100000:0.0:1783562448.135477:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562448.135488:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563639040:12345-0@lo:104: 00010000:00010000:0.0:1783562448.135508:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562448.135598:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562448.135606:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563639040:12345-0@lo:104: Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562448.135615:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562448.135639:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563639040:0@lo:104: 00010000:00010000:2.0:1783562448.135675:0:14185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.135890:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562448.135898:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.135908:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562448.135913:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.135923:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562448.135931:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562448.135947:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562448.135993:0:14158:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136002:0:14158:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562448.136039:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136047:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336000/0x4738ba0933b88ebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ec4 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136069:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562448.136072:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562448.136074:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562448.136088:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563639168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562448.136137:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562448.136445:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639168 00000100:00100000:1.0:1783562448.136452:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639168 00010000:00010000:1.0:1783562448.136494:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 13 pid: 14163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562448.136542:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562448.136553:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+13:3275:x1870200563639168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562448.136566:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562448.136573:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 13 pid: 14163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136587:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 13 pid: 14163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136604:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6683e00/0x4738ba0933b88ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88ebd expref: 13 pid: 14163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136621:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136630:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562448.136656:0:14154:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001637584s 00010000:00010000:1.0:1783562448.136672:0:14154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136680:0:14154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136687:0:14154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136694:0:14154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136700:0:14154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562448.136704:0:14154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136712:0:14154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136733:0:14154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562448.136745:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562448.136791:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:3275:x1870200563639168:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562448.136798:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562448.136838:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563639168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562448.136947:0:14185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.136957:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562448.136965:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b88ef5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562448.139826:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14151:x1870200563638912:12345-0@lo:253:mount.lustre.0 Request processed in 24666us (24799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562448.139845:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783562448.139995:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14151:1870200563638912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783562448.140015:0:14151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783562448.140032:0:14151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783562448.140034:0:14151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562448.140035:0:14151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562448.140037:0:14151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562448.140038:0:14151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562448.140040:0:14151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562448.140041:0:14151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562448.140043:0:14151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562448.140045:0:14151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562448.140046:0:14151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783562448.140063:0:14151:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783562448.146333:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562448.146607:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562448.147035:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562448.147216:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562448.147552:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562448.147723:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562448.149255:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562448.149456:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562448.149833:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562448.149971:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562448.150219:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562448.150358:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783562448.165769:0:14151:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783562448.166305:0:14151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783562448.166365:0:14208:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783562448.166371:0:14208:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1783562448.166590:0:14209:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1783562448.166706:0:14209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783562448.168543:0:14209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783562448.168632:0:14209:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783562448.168637:0:14209:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1783562448.168712:0:14151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783562448.168852:0:14151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783562448.169259:0:14151:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783562448.169265:0:14151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783562448.169356:0:14151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562448.170190:0:14151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783562448.170707:0:14151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783562448.170766:0:14151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783562448.171188:0:14151:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1783562448.172090:0:14151:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1783562448.176192:0:14151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1783562448.197590:0:14151:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783562448.197636:0:14151:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac9e01d77988 00100000:10000000:3.0:1783562448.197645:0:14151:0:(lfsck_lib.c:3088:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783562448.198618:0:14151:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783562448.198635:0:14151:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783562448.198650:0:14151:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1783562448.198679:0:14151:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783562448.950565:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562449.143477:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783562449.143488:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562449.143888:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1783562449.143894:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1783562449.206600:0:14166:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783562449.206608:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcf6881000 from 6 10000000:01000000:3.0:1783562449.206615:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783562449.206686:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562449.206697:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562449.206716:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562449.206744:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783562449.206884:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562449.206973:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659000 going to sleep for 11 seconds 00000100:00100000:0.0:1783562449.207042:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639296 00000100:00100000:0.0:1783562449.207053:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639296 00000100:00100000:0.0:1783562449.207110:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783562449.207122:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14166:x1870200563639296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562449.207138:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562449.207156:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88efc expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562449.207191:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88efc expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562449.207202:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88efc expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562449.207290:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8400, rc 0) 00000100:00100000:0.0:1783562449.207338:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562449.207355:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783562449.207451:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562449.207465:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562449.207474:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562449.207523:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783562449.207552:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562449.207614:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659000 going to sleep for 11 seconds 00000100:00100000:0.0:1783562449.207660:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639424 00000100:00100000:0.0:1783562449.207665:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639424 00000100:00100000:0.0:1783562449.207697:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783562449.207704:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783562449.207718:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783562449.207737:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783562449.207741:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783562449.208000:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 295us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562449.208007:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562449.208064:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783562449.208106:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783562449.208113:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562449.208127:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562449.976097:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562450.002985:0:14452:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1783562450.166695:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783562450.166707:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562450.166744:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1783562450.166752:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783562450.998629:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562451.434224:0:14602:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea1f1cfc0 20000000:00000080:3.0:1783562451.434246:0:14602:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcd1046000 uarg=0000000000000000 20000000:01000000:3.0:1783562451.434284:0:14602:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783562451.434291:0:14602:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783562451.434297:0:14602:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783562451.435266:0:14603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1783562451.435360:0:14602:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783562451.440634:0:14602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783562451.440678:0:14602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562451.440699:0:14602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562451.440724:0:14602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562451.440769:0:14602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562451.440782:0:14602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 11 pid: 14163 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562451.440798:0:14602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14602:1870200563639552:0@lo:104: 00000100:00100000:0.0:1783562451.440869:0:14602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562451.440925:0:14602:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfd00e00600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562451.441012:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639552 00000100:00100000:2.0:1783562451.441021:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639552 00000100:00100000:2.0:1783562451.441075:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562451.441086:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14602:x1870200563639552:12345-0@lo:104: 00010000:00010000:2.0:1783562451.441100:0:14153:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562451.441164:0:14153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783562451.441171:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14602:x1870200563639552:12345-0@lo:104: Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562451.441179:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562451.441197:0:14602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14602:1870200563639552:0@lo:104: 00010000:00010000:0.0:1783562451.441222:0:14602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441244:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562451.441260:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441273:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562451.441278:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441289:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562451.441298:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562451.441324:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783562451.441382:0:14158:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441391:0:14158:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562451.441444:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441452:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682e00/0x4738ba0933b88ecb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88ed2 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562451.441485:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562451.441487:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562451.441489:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562451.441631:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563639680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562451.441675:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562451.441744:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639680 00000100:00100000:3.0:1783562451.441750:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639680 00010000:00010000:3.0:1783562451.441772:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 12 pid: 14163 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562451.441798:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562451.441805:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:3272:x1870200563639680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562451.441817:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562451.441823:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 12 pid: 14163 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441833:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 12 pid: 14163 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441846:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1da00/0x4738ba0933b88ed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88ecb expref: 12 pid: 14163 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441862:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441867:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441877:0:14156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441884:0:14156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441891:0:14156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441898:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441904:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562451.441908:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441917:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441945:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562451.441955:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562451.441995:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:3272:x1870200563639680:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (318us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562451.442005:0:14602:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562451.442013:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783562451.442020:0:14602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562451.442029:0:14602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9c00/0x4738ba0933b88f0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562451.442063:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563639680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562452.022614:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783562452.470534:0:14166:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783562452.470545:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6881000 from 10 10000000:01000000:0.0:1783562452.470551:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562452.470631:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562452.470656:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562452.470670:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562452.470703:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783562452.470800:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562452.470856:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639808 00000100:00100000:1.0:1783562452.470864:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639808 00000100:00100000:0.0:1783562452.470869:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562452.470928:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562452.470940:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+11:14166:x1870200563639808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562452.470956:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562452.470971:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f11 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562452.470997:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562452.471019:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562452.471040:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683200, rc 0) 00000100:00100000:1.0:1783562452.471092:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562452.471100:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783562452.471132:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562452.471158:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562452.471170:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562452.471226:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562452.471252:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562452.471272:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562452.471312:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563639936 00000100:00100000:1.0:1783562452.471317:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563639936 00000100:00100000:1.0:1783562452.471347:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783562452.471355:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562452.471833:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563639936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 478us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562452.471841:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783562452.471861:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563639936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562452.471902:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563640064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562452.471955:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562452.471981:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562452.472220:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640064 00000100:00100000:1.0:1783562452.472224:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640064 00000100:00100000:1.0:1783562452.472246:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783562452.472251:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563640064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562452.472374:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14166:x1870200563640064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562452.472379:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783562452.472460:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563640064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783562452.473307:0:14709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783562452.473386:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783562452.473435:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562452.473445:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562452.473455:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.046515:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783562453.248826:0:14802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783562453.248830:0:14802:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1783562453.248908:0:14802:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfcf6161000 00000020:01000004:0.0:1783562453.248920:0:14802:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783562453.248930:0:14802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783562453.248941:0:14802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bfcc5040000) 00000020:00000080:0.0:1783562453.248953:0:14802:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783562453.260498:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783562453.260784:0:14802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783562453.262547:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783562453.262858:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783562453.263088:0:14802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783562453.263596:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 225: rc = 0 00100000:10000000:0.0:1783562453.263758:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 225: rc = 0 00100000:10000000:0.0:1783562453.263855:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 225: rc = 0 00100000:10000000:0.0:1783562453.264373:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 641: rc = 0 00100000:10000000:0.0:1783562453.264691:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 641: rc = 0 00100000:10000000:0.0:1783562453.265783:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:0.0:1783562453.266049:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1783562453.266310:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 641: rc = 0 00100000:10000000:0.0:1783562453.266614:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00000020:00000080:0.0:1783562453.267243:0:14802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783562453.267254:0:14802:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783562453.267265:0:14802:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b88f26 00000020:01000004:0.0:1783562453.267273:0:14802:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1783562453.267294:0:14802:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783562453.267297:0:14802:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783562453.267303:0:14802:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783562453.267307:0:14802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783562453.267324:0:14802:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bfcc5044d40) 00000020:00000080:0.0:1783562453.267336:0:14802:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783562453.268477:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562453.268620:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783562453.268626:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783562453.269639:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562453.269646:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783562453.270004:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562453.270011:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783562453.271855:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562453.272027:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783562453.272034:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783562453.272621:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783562453.272628:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783562453.283961:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562453.284190:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562453.284196:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783562453.285588:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783562453.285598:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783562453.286476:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783562453.286485:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783562453.288474:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562453.288638:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783562453.288644:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783562453.289151:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783562453.289159:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783562453.314080:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562453.314350:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783562453.314359:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783562453.315504:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783562453.315512:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783562453.315828:0:14802:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783562453.315856:0:14802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783562453.315863:0:14802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783562453.323545:0:14802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783562453.323593:0:14802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783562453.323598:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783562453.323599:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562453.323601:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562453.323602:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562453.323603:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562453.323605:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562453.323606:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562453.323608:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562453.323609:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562453.323613:0:14802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783562453.323616:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783562453.323617:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562453.323618:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562453.323619:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562453.323626:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562453.323627:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562453.323628:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562453.323629:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562453.323630:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562453.323657:0:14802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783562453.323679:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783562453.323760:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562453.323829:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640192 00000100:00100000:1.0:1783562453.323849:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640192 00000100:00100000:3.0:1783562453.323887:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218000 going to sleep for 11 seconds 00000100:00100000:1.0:1783562453.323935:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783562453.323949:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14802:x1870200563640192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783562453.324024:0:14163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783562453.324028:0:14163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783562453.324032:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783562453.328660:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14802:x1870200563640192:12345-0@lo:253:mount.lustre.0 Request processed in 4707us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.328675:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783562453.328716:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783562453.328736:0:14802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783562453.328740:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783562453.328742:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562453.328743:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562453.328745:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562453.328746:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562453.328747:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562453.328749:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562453.328752:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562453.328753:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783562453.328777:0:14802:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfcf6161000 from lustre-OST0000 10000000:01000000:3.0:1783562453.328808:0:14802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783562453.328811:0:14802:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783562453.328819:0:14802:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfcf6b90000 local copy 00010000:00010000:3.0:1783562453.328830:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562453.329097:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562453.329134:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.329182:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218600 going to sleep for 11 seconds 00000100:00100000:1.0:1783562453.329189:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640320 00000100:00100000:1.0:1783562453.329196:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640320 00000100:00100000:1.0:1783562453.329236:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783562453.329256:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14802:x1870200563640320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562453.329452:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14802:x1870200563640320:12345-0@lo:501:mount.lustre.0 Request processed in 197us (317us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562453.329461:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783562453.329491:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783562453.329527:0:14802:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783562453.329778:0:14802:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783562453.329787:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.329798:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562453.329826:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcf6161000 10000000:01000000:3.0:1783562453.329832:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783562453.329838:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bfcf6b90000 10000000:01000000:3.0:1783562453.329841:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783562453.329844:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9bfcf6b90000 from 1 10000000:01000000:3.0:1783562453.329848:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783562453.329876:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.329886:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.329897:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562453.329914:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562453.329952:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.329999:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218600 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.330072:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640448 00000100:00100000:0.0:1783562453.330079:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640448 00000100:00100000:0.0:1783562453.330118:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783562453.330128:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+12:14802:x1870200563640448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562453.330140:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562453.330158:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b88f3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f34 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.330184:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b88f3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f34 expref: 13 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.330197:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b88f3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f34 expref: 13 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.330208:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8600, rc 0) 00000100:00100000:0.0:1783562453.330315:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+13:14802:x1870200563640448:12345-0@lo:101:mount.lustre.0 Request processed in 188us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.330324:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783562453.330540:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562453.330559:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.330584:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562453.330616:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783562453.330635:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.330646:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562453.330655:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783562453.330660:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562453.330667:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783562453.330670:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562453.330693:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.330702:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.330711:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562453.330728:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562453.330765:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.330800:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218600 going to sleep for 11 seconds 00000100:00100000:1.0:1783562453.330819:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640576 00000100:00100000:1.0:1783562453.330824:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640576 00000100:00100000:1.0:1783562453.330856:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783562453.330864:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+13:14802:x1870200563640576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562453.330871:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562453.330882:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b88f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f42 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.330909:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b88f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f42 expref: 14 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.330918:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b88f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f42 expref: 14 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.330925:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682000, rc 0) 00000100:00100000:1.0:1783562453.330959:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640576:12345-0@lo:101:mount.lustre.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562453.330966:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783562453.331013:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562453.331026:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.331036:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562453.331992:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783562453.333295:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562453.333740:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783562453.333806:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783562453.333862:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783562453.333939:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783562453.333996:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783562453.334052:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783562453.334142:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783562453.334153:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783562453.334255:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562453.334326:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.334383:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218180 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.334388:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640704 00000100:00100000:0.0:1783562453.334397:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640704 00000100:00100000:0.0:1783562453.334527:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783562453.334539:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562453.334889:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640704:12345-0@lo:501:mount.lustre.0 Request processed in 351us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.334897:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783562453.334939:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562453.334980:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562453.335034:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.335078:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562453.335154:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640832 00000100:00100000:1.0:1783562453.335161:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640832 00000100:00100000:2.0:1783562453.335606:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783562453.335632:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562453.336081:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640832:12345-0@lo:503:mount.lustre.0 Request processed in 461us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562453.336090:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783562453.336137:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783562453.337274:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783562453.337363:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562453.337475:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562453.337530:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563640960 00000100:00100000:3.0:1783562453.337534:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218180 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.337538:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563640960 00000100:00100000:0.0:1783562453.337595:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783562453.337607:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562453.337883:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563640960:12345-0@lo:502:mount.lustre.0 Request processed in 279us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.337890:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783562453.337937:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563640960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783562453.338285:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783562453.338357:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783562453.338474:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783562453.338590:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783562453.338653:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783562453.338708:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783562453.338785:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783562453.338840:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783562453.338907:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783562453.338987:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783562453.339048:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783562453.339117:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783562453.339158:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562453.339229:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.339284:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562453.339314:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641088 00000100:00100000:2.0:1783562453.339321:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641088 00000100:00100000:2.0:1783562453.339367:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783562453.339377:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563641088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562453.339602:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563641088:12345-0@lo:502:mount.lustre.0 Request processed in 226us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562453.339610:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783562453.339701:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783562453.339797:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783562453.339809:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1783562453.340965:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783562453.340975:0:14817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1783562453.340983:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.340986:0:14817:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783562453.340994:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783562453.341011:0:14817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bfcf6b919c0) 00000020:00000080:3.0:1783562453.341037:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783562453.341045:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783562453.341118:0:14817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6161000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783562453.341128:0:14817:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783562453.341141:0:14817:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b88f57 00010000:00010000:3.0:1783562453.346102:0:14817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1783562453.346730:0:14817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1783562453.348865:0:14817:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783562453.351902:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783562453.351933:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562453.351942:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.351945:0:14817:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783562453.351950:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783562453.351954:0:14817:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1783562453.351956:0:14817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783562453.351958:0:14817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783562453.351960:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783562453.351963:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.351966:0:14817:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783562453.351970:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562453.351976:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.351978:0:14817:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783562453.351983:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783562453.351985:0:14817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783562453.351988:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562453.351992:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.351993:0:14817:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783562453.351997:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562453.352001:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.352004:0:14817:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783562453.352009:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783562453.352094:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562453.352099:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562453.352100:0:14817:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783562453.352104:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783562453.352223:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783562453.352256:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783562453.352284:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.352296:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562453.352317:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6161000 from 1 10000000:01000000:2.0:1783562453.352320:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562453.352449:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.352458:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.352469:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562453.352497:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783562453.352779:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562453.352813:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641216 00000100:00100000:0.0:1783562453.352821:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641216 00000100:00100000:2.0:1783562453.352833:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.352871:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783562453.352878:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+14:14802:x1870200563641216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562453.352890:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562453.352903:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f5e expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.352923:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 15 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.352931:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 15 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.352947:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc5cb8800, rc 0) 00000100:00100000:0.0:1783562453.352986:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641216:12345-0@lo:101:mount.lustre.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.352995:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783562453.353177:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562453.353194:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.353204:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562453.354139:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783562453.354764:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562453.354976:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783562453.355013:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783562453.355065:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783562453.355073:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783562453.355138:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562453.355192:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562453.355225:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.355237:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641344 00000100:00100000:0.0:1783562453.355246:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641344 00000100:00100000:0.0:1783562453.355286:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783562453.355295:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562453.355509:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641344:12345-0@lo:501:mount.lustre.0 Request processed in 215us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.355518:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783562453.355611:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562453.355646:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562453.355692:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562453.355757:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.355796:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641472 00000100:00100000:0.0:1783562453.355801:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641472 00000100:00100000:0.0:1783562453.355843:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783562453.355851:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562453.356086:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641472:12345-0@lo:503:mount.lustre.0 Request processed in 234us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.356094:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783562453.356163:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783562453.357003:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783562453.357070:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562453.357118:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562453.357143:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.357158:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641600 00000100:00100000:0.0:1783562453.357164:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641600 00000100:00100000:0.0:1783562453.357196:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783562453.357204:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562453.357353:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641600:12345-0@lo:502:mount.lustre.0 Request processed in 148us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.357361:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783562453.357378:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562453.357590:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783562453.357621:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783562453.357647:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783562453.357677:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783562453.357695:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783562453.357724:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783562453.357743:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783562453.357770:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783562453.357785:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562453.357811:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562453.357828:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.357848:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641728 00000100:00100000:0.0:1783562453.357853:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641728 00000100:00100000:0.0:1783562453.357880:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783562453.357888:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562453.358009:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641728:12345-0@lo:502:mount.lustre.0 Request processed in 122us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.358017:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783562453.358041:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562453.358114:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783562453.358121:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1783562453.358805:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562453.358815:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358817:0:14821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783562453.358824:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6161000 00000020:00000080:1.0:1783562453.358827:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783562453.358834:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562453.358837:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358849:0:14821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783562453.358852:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562453.358855:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358856:0:14821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783562453.358860:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6161000 00000020:00000080:1.0:1783562453.358862:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783562453.358912:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562453.358915:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358917:0:14821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783562453.358920:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562453.358923:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358925:0:14821:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783562453.358929:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcf6161000 00000020:00000080:1.0:1783562453.358931:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783562453.358982:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562453.358986:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562453.358988:0:14821:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783562453.358991:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783562453.359781:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783562453.359846:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783562453.359884:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.359900:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562453.359984:0:14802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783562453.359988:0:14802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcf6161000 10000000:01000000:2.0:1783562453.359992:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcf6161000 10000000:01000000:2.0:1783562453.359997:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783562453.360005:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcf6161000 from 1 10000000:01000000:2.0:1783562453.360008:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783562453.360054:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.360064:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.360077:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562453.360107:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783562453.360193:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.360262:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641856 00000100:00100000:3.0:1783562453.360274:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641856 00000100:00100000:2.0:1783562453.360278:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562453.360362:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783562453.360380:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563641856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562453.360448:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562453.360473:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b88f73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f6c expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.360533:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b88f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f6c expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.360549:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b88f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f6c expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.360574:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:3.0:1783562453.360659:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563641856:12345-0@lo:101:mount.lustre.0 Request processed in 284us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562453.360669:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783562453.361156:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563641856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562453.361196:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.361211:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562453.362465:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783562453.363084:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562453.363959:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783562453.364300:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783562453.364455:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783562453.364658:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783562453.364767:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783562453.364922:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783562453.365016:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783562453.365244:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783562453.365452:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783562453.365599:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783562453.365743:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783562453.365925:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783562453.366058:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783562453.366277:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000100:00080000:3.0:1783562453.366486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783562453.366492:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783562453.366496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783562453.366499:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783562453.366503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783562453.366507:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783562453.366512:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ecf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783562453.366526:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bfcc3ecf000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562453.366584:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef1a9500 x1870200563641984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1783562453.366595:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000100:00100000:3.0:1783562453.366648:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563641984:0@lo:38:kworker.0 00000040:00080000:2.0:1783562453.366677:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000100:00100000:3.0:1783562453.366731:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783562453.366754:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000100:00100000:3.0:1783562453.366794:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563641984 00000100:00100000:3.0:1783562453.366802:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563641984 00000100:00100000:3.0:1783562453.366845:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562453.366853:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3271:x1870200563641984:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783562453.366882:0:14171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000040:00080000:2.0:1783562453.366906:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000020:00000080:3.0:1783562453.366929:0:14171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4738ba0933b88f7a 00000004:00100000:3.0:1783562453.366947:0:14171:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:2.0:1783562453.367000:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000100:00080000:3.0:1783562453.367132:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562453.367197:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1870200563641984:12345-0@lo:38:kworker.0 Request processed in 342us (465us total) trans 0 rc 0/0 00000040:00080000:2.0:1783562453.367204:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000100:00100000:3.0:1783562453.367208:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783562453.367254:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcef1a9500 x1870200563641984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783562453.367269:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783562453.367277:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783562453.367282:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783562453.367285:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ecf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783562453.367291:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563641984:0@lo:38:kworker.0 00000040:00080000:2.0:1783562453.367626:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783562453.367780:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783562453.367892:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783562453.368020:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783562453.368290:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783562453.368684:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783562453.368919:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783562453.369299:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783562453.375523:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783562453.375808:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783562453.376071:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562453.376148:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562453.376191:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642112 00000100:00100000:0.0:1783562453.376199:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642112 00000100:00100000:0.0:1783562453.376265:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783562453.376276:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562453.376557:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642112:12345-0@lo:501:mount.lustre.0 Request processed in 281us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.376579:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783562453.376731:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5120e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562453.376773:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562453.376834:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562453.376956:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562453.377187:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642240 00000100:00100000:0.0:1783562453.377192:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642240 00000100:00100000:0.0:1783562453.377222:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783562453.377230:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562453.377437:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642240:12345-0@lo:503:mount.lustre.0 Request processed in 208us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.377446:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783562453.377996:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562453.378026:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783562453.381268:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562453.381478:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562453.381671:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562453.381743:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642368 00000100:00100000:2.0:1783562453.381754:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642368 00000100:00100000:2.0:1783562453.381858:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783562453.381877:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562453.382534:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0eef180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562453.382662:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642368:12345-0@lo:502:mount.lustre.0 Request processed in 790us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562453.382675:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783562453.382679:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9296300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783562453.383086:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783562453.383155:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783562453.383212:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783562453.383323:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783562453.383438:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783562453.383512:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783562453.383583:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783562453.383673:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783562453.383762:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783562453.383809:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783562453.383840:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783562453.383877:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783562453.383914:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783562453.383951:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783562453.384027:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783562453.384073:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783562453.384126:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783562453.384204:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783562453.384273:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783562453.384326:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783562453.384460:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783562453.384519:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783562453.384583:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783562453.384671:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783562453.384715:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783562453.384763:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783562453.384817:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783562453.384856:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783562453.384894:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783562453.384963:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783562453.385036:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783562453.385084:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783562453.385118:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783562453.385181:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1783562453.385249:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1783562453.385336:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1783562453.385387:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1783562453.385462:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1783562453.385524:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1783562453.385611:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1783562453.385665:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562453.385753:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562453.385787:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562453.385801:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642496 00000100:00100000:0.0:1783562453.385810:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642496 00000100:00100000:0.0:1783562453.385868:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783562453.385878:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562453.386136:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642496:12345-0@lo:502:mount.lustre.0 Request processed in 260us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.386145:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783562453.386183:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783562453.386262:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783562453.386274:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783562453.387381:0:14827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783562453.387623:0:14827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bfbc6a44d40) 00000020:00000080:0.0:1783562453.388224:0:14827:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1783562453.389702:0:14827:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6161000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783562453.389709:0:14827:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6161000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783562453.389712:0:14827:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6161000 3 00010000:00080000:1.0:1783562453.389747:0:14827:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfd00d43000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562453.391943:0:14827:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1783562453.392070:0:14827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783562453.392111:0:14827:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783562453.392129:0:14827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4738ba0933b88f88 00000100:00080000:1.0:1783562453.392141:0:14827:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562453.392147:0:14827:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bfd00d43000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562453.392187:0:14827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9aca80 x1870200563642624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562453.392223:0:14827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783562453.392258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562453.392262:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783562453.392266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562453.392269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783562453.392290:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563642624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783562453.392372:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783562453.392837:0:14827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783562453.393837:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783562453.393881:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783562453.393896:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.393906:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562453.394034:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642624 00000100:00100000:0.0:1783562453.394052:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642624 00000020:01000004:3.0:1783562453.394083:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783562453.394087:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562453.394089:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562453.394091:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562453.394093:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562453.394096:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562453.394098:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562453.394101:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562453.394103:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783562453.394110:0:14802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783562453.394115:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783562453.394119:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562453.394120:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562453.394128:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1783562453.394128:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1783562453.394133:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562453.394137:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562453.394139:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562453.394142:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1783562453.394146:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3271:x1870200563642624:12345-0@lo:38:llog_process_th.0 00000020:01000004:3.0:1783562453.394153:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783562453.394182:0:14802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00010000:00080000:0.0:1783562453.394195:0:14170:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000100:00100000:3.0:1783562453.394253:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783562453.394325:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1783562453.394338:0:14170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4738ba0933b88f8f 00000004:00100000:0.0:1783562453.394366:0:14170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783562453.394381:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642752 00000100:00100000:3.0:1783562453.394391:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642752 00000100:00100000:3.0:1783562453.394453:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783562453.394465:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14802:x1870200563642752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783562453.394492:0:14163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783562453.394506:0:14163:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1783562453.394626:0:14170:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6a52000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562453.394693:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1870200563642624:12345-0@lo:38:llog_process_th.0 Request processed in 549us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.394709:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783562453.394784:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcef9aca80 x1870200563642624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562453.394796:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562453.394805:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783562453.394814:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783562453.394821:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783562453.394824:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfd00d43000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783562453.394842:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563642624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783562453.394973:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218300 going to sleep for 11 seconds 20000000:01000000:3.0:1783562453.407480:0:14163:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783562453.407656:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783562453.407726:0:14185:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783562453.407733:0:14185:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783562453.407758:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.407779:0:14185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88efc expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.407809:0:14185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.407853:0:14185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562453.407869:0:14185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 16 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562453.407886:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563642880:0@lo:104: 00000100:00100000:2.0:1783562453.407971:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562453.408091:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0eef840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562453.408149:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563642880 00000100:00100000:3.0:1783562453.408157:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563642880 00000100:00100000:3.0:1783562453.408266:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562453.408280:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563642880:12345-0@lo:104: 00010000:00010000:3.0:1783562453.408295:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562453.408376:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783562453.408386:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563642880:12345-0@lo:104: Request processed in 110us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562453.408391:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563642880:0@lo:104: 00000100:00100000:3.0:1783562453.408399:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783562453.408439:0:14185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408502:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562453.408509:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408518:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562453.408523:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408541:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562453.408549:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562453.408554:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562453.408601:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408609:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562453.408637:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408643:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336800/0x4738ba0933b88efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f03 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562453.408656:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563643008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562453.408657:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562453.408659:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562453.408662:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562453.408694:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562453.408830:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643008 00000100:00100000:1.0:1783562453.408835:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643008 00010000:00010000:1.0:1783562453.408864:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 17 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562453.408892:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562453.408901:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:3273:x1870200563643008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562453.408901:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783562453.408914:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1783562453.408918:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562453.408925:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 17 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408946:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 17 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408960:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8400/0x4738ba0933b88f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88efc expref: 17 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408973:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.408993:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562453.409008:0:14154:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001637584s 00010000:00010000:1.0:1783562453.409013:0:14154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409021:0:14154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409027:0:14154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409034:0:14154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409041:0:14154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ca00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562453.409046:0:14154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409054:0:14154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409081:0:14154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562453.409089:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562453.409103:0:14185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562453.409113:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562453.409122:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3273:x1870200563643008:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (427us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562453.409124:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b88f96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562453.409132:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562453.409313:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563643008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562453.417940:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14802:x1870200563642752:12345-0@lo:253:mount.lustre.0 Request processed in 23468us (23609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562453.417958:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783562453.417975:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14802:1870200563642752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783562453.417994:0:14802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783562453.417998:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783562453.418000:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783562453.418001:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562453.418002:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562453.418004:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562453.418005:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562453.418006:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562453.418008:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562453.418009:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783562453.418026:0:14802:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783562453.422215:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562453.422383:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562453.422718:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562453.422872:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562453.423126:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562453.423330:0:14802:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783562453.424200:0:14802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783562453.451645:0:14802:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783562453.451654:0:14802:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783562453.451697:0:14802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783562453.451758:0:14802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783562453.451772:0:14802:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783562453.451800:0:14802:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783562454.071061:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562455.094589:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783562455.222471:0:14166:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783562455.222478:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcf6881000 from 7 10000000:01000000:2.0:1783562455.222483:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783562455.222543:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562455.222556:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562455.222567:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562455.222594:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563643136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562455.222674:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562455.222744:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562455.222754:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643136 00000100:00100000:3.0:1783562455.222762:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643136 00000100:00100000:3.0:1783562455.222822:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783562455.222832:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:14166:x1870200563643136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562455.222845:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562455.222859:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b88f9d expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562455.222892:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562455.222903:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 16 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562455.222913:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336000, rc 0) 00000100:00100000:3.0:1783562455.222952:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14166:x1870200563643136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562455.222959:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783562455.222983:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563643136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562455.223000:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562455.223008:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562455.223050:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563643264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783562455.223087:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562455.223103:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562455.223124:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643264 00000100:00100000:3.0:1783562455.223129:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643264 00000100:00100000:3.0:1783562455.223152:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783562455.223158:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14166:x1870200563643264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783562455.223171:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783562455.223186:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783562455.223190:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783562455.223264:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14166:x1870200563643264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562455.223271:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783562455.223279:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563643264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783562455.223334:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783562455.223341:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562455.223349:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1783562455.952133:0:15173:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783562456.118558:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562457.142622:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.167046:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562458.487869:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563643392:0@lo:400:kworker.0 00000100:00080000:2.0:1783562458.487950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562458.487955:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783562458.487958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562458.487960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783562458.488013:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563643520:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.488175:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.488255:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643392 00000100:00100000:3.0:1783562458.488264:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643392 00000100:00100000:3.0:1783562458.488310:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783562458.488320:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3274:x1870200563643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.488391:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3274:x1870200563643392:12345-0@lo:400:kworker.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.488399:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783562458.488531:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.488577:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563643648:0@lo:400:kworker.0 00000100:00100000:2.0:1783562458.488608:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.488676:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643520 00000100:00100000:2.0:1783562458.488680:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643520 00000100:00100000:1.0:1783562458.488712:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563643392:0@lo:400:kworker.0 00000100:00100000:2.0:1783562458.488726:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643648 00000100:00100000:2.0:1783562458.488731:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643648 00000100:00100000:2.0:1783562458.488770:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783562458.488775:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562458.488780:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563643520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562458.488824:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563643520:12345-0@lo:400:kworker.0 Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.488831:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562458.488845:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562458.488852:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563643648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562458.488905:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563643648:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.488913:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783562458.488957:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfbc9294a80 x1870200563643648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562458.488970:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563643648:0@lo:400:kworker.0 00010000:00080000:2.0:1783562458.489088:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfbc9295880 x1870200563643520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562458.489098:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563643520:0@lo:400:kworker.0 00000100:00100000:0.0:1783562458.550637:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562448/real 1783562448] req@ffff9bfcef9ac000 x1870200563636992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562458.550675:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcef9ac000 x1870200563636992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562458.550686:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562448/real 1783562448] req@ffff9bfcef9af100 x1870200563636864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562458.550698:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcef9af100 x1870200563636864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783562458.550718:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562458.550748:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783562458.550753:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563636992:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783562458.550758:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc6403000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562458.550764:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783562458.550767:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563636864:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783562458.550828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562458.550834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783562458.550838:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bfcc6403000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562458.550843:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 257 00000100:00080000:1.0:1783562458.550848:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783562458.550855:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bfcc6403000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562458.550890:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9ac380 x1870200563643776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562458.550929:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562458.550933:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783562458.550935:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562458.550938:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 257 00000100:00080000:1.0:1783562458.550941:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783562458.550945:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcd0d32800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562458.550959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9aea00 x1870200563643904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562458.551018:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563643776:0@lo:8:kworker.0 00000100:00100000:0.0:1783562458.551088:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562458.551138:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563643904:0@lo:8:kworker.0 00000100:00100000:3.0:1783562458.551155:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643776 00000100:00100000:3.0:1783562458.551164:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643776 00000100:00100000:0.0:1783562458.551196:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.551269:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563643904 00000100:00100000:3.0:1783562458.551274:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563643904 00000100:00100000:3.0:1783562458.551293:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562458.551301:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3271:x1870200563643776:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783562458.551326:0:14803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1783562458.551368:0:14803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b88fab 00002000:00100000:3.0:1783562458.551383:0:14803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bfcc7e30000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783562458.551387:0:14803:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783562458.551390:0:14803:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783562458.551787:0:14803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783562458.551814:0:14803:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e36000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562458.551875:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563643776:12345-0@lo:8:kworker.0 Request processed in 573us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.551882:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562458.551900:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562458.551904:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3271:x1870200563643904:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783562458.551915:0:14803:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783562458.551938:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3271:x1870200563643904:12345-0@lo:8:kworker.0 Request processed in 33us (743us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783562458.551951:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783562458.552103:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef9ac380 x1870200563643776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562458.552113:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562458.552119:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783562458.552127:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783562458.552132:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783562458.552134:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc6403000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783562458.552197:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783562458.552202:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563643776:0@lo:8:kworker.0 00000100:00080000:0.0:1783562458.552216:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562458.552219:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783562458.552222:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563643904:0@lo:8:kworker.0 00000004:00080000:1.0:1783562458.552292:0:14191:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783562458.552547:0:14191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267809142856ns, next at 0ns, rc = 0 00000004:00080000:3.0:1783562458.552732:0:14192:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783562458.552752:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14192:1870200563644160:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783562458.552790:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.552810:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.552827:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644160 00000100:00100000:3.0:1783562458.552831:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644160 00000100:00100000:3.0:1783562458.552864:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562458.552871:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14192:x1870200563644160:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783562458.552925:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563644032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562458.552963:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783562458.553014:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562458.553052:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644032 00000100:00100000:2.0:1783562458.553057:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644032 00000100:00100000:2.0:1783562458.553088:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562458.553096:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563644032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783562458.553118:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562458.553150:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563644032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.553155:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783562458.553251:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef1aa680 x1870200563644032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562458.553269:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563644032:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1783562458.557377:0:14806:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783562458.557387:0:14806:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783562458.557393:0:14806:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1783562458.568476:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.568490:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.568506:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.568512:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.568518:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.568535:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.568546:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.568554:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.568584:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562458.569200:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562458.569214:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.569229:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562458.569235:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.569247:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.569277:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.569300:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b88fb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.569333:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562458.569336:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562458.569338:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.569681:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.569689:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.569701:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.569705:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.569709:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.569720:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.569728:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.571209:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.571394:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.572159:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.572169:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.572181:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.572187:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.572198:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.572221:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.572241:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b88fb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.572263:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.572265:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.572267:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.572653:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.572662:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.572674:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.572684:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.572690:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.572703:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.572712:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.572720:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.572736:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.572797:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.572805:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.572815:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.572819:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.572828:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.572854:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.572862:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009492b43c/0x4738ba0933b88fc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.572919:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.572926:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.572933:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.574900:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.574914:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.574930:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.574935:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.574941:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.574957:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.574968:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.574983:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.575019:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.575068:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.575078:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.575088:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.575096:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.575108:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.575135:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.575143:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b88fc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.575194:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.575199:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.575208:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.576654:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.576665:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.576679:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.576683:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.576690:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.576703:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.576713:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.576722:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.576751:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.577134:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.577142:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.577163:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.577169:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.577178:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.577194:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.577201:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b88fce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.577223:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.577225:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.577226:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.578257:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.578266:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.578399:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.578430:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.578435:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.578448:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.578457:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.578475:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.578492:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.579138:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.579147:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.579157:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.579161:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.579170:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.579200:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.579207:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b88fd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.579229:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.579231:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.579233:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.579944:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.579953:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.579964:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.579968:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.579973:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.579985:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580007:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580014:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580175:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783562458.580882:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.580890:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580902:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.580906:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.580911:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580922:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580931:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.580938:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581216:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562458.581225:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581235:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.581241:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581251:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581276:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581359:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b88fdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562458.581382:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783562458.581397:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.581431:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581438:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.581441:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581450:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581472:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.581481:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.581483:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.581485:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.581579:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783562458.581586:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001884dfdb/0x4738ba0933b88fe3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.582130:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.582493:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.582502:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.582514:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.582517:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.582522:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.582534:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.582544:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.582552:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.582607:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783562458.583133:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.583140:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.583156:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.583160:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.583166:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.583176:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.583183:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.583191:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583471:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562458.583479:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583488:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.583493:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583515:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583531:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583538:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b88fea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583558:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.583561:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583568:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.583571:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583578:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583587:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.583593:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.583595:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.583602:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.583691:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783562458.583697:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b88ff1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783562458.584280:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562458.584424:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.584487:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.584498:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.584501:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.584506:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.584530:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.584540:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.584549:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.584604:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783562458.585188:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.585195:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.585205:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.585208:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.585213:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.585223:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.585230:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.585249:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585541:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562458.585547:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585556:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.585561:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585569:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585585:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585592:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b88ff8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585613:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.585617:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585625:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.585628:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585650:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585661:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.585670:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.585671:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.585674:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.585765:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783562458.585772:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b88fff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.586714:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562458.587604:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562458.587618:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.587635:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=267s v=(0 0) 00010000:00010000:2.0:1783562458.587640:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562458.587647:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.587661:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.587672:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.587680:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.587711:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562458.588180:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562458.588191:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588199:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=267s v=(0 0) 00010000:00010000:2.0:1783562458.588203:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562458.588207:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588216:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588224:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588232:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588250:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562458.588269:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562458.588278:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588286:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.588290:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588298:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588315:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588320:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db4956a/0x4738ba0933b89006 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588338:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.588341:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588353:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.588356:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588360:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588366:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588371:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b22eab9a/0x4738ba0933b8900d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588383:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.588384:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.588386:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562458.588693:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562458.588699:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588707:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=267s v=(0 0) 00010000:00010000:2.0:1783562458.588710:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562458.588714:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588723:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588736:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588742:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.588758:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.588775:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.588780:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588786:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1de00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.588789:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588794:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588810:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588816:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089eed2e5/0x4738ba0933b89014 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.588830:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.588831:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.588832:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562458.589125:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562458.589131:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.589139:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=267s v=(0 0) 00010000:00010000:2.0:1783562458.589142:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562458.589146:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.589154:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.589162:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.589169:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.589192:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.589207:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.589213:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.589221:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.589224:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.589233:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.589245:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.589252:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43a8dbd/0x4738ba0933b8901b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.589280:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.589282:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.589284:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.591100:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.591117:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.591127:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.591134:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.591140:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.591146:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591159:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591169:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591177:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591217:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.591307:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.591316:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.591327:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.591333:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.591342:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.591363:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.591371:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000772cad98/0x4738ba0933b89022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.591444:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.591448:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.591451:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.591929:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.591938:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591949:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.591953:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.591958:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591968:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591977:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.591985:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.592011:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.592093:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.592103:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.592129:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.592133:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.592144:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.592162:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.592172:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747b0c4b/0x4738ba0933b89029 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.592210:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.592215:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.592218:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.592872:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.592881:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.592892:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.592905:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.592910:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.592921:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.592931:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.592938:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.593640:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.593717:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.593726:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.593740:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.593745:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.593756:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.593787:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.593796:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afabd897/0x4738ba0933b89030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.593822:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.593824:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.593828:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.594602:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.594612:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594627:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.594631:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.594637:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594649:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594658:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594673:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594699:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562458.594716:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562458.594723:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594731:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562458.594736:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594745:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594764:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594773:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000852186f5/0x4738ba0933b89037 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.594803:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.594808:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562458.594811:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.595937:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.595955:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.595966:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.595971:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.595975:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.595987:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.595996:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.596003:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.596603:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562458.596644:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.596655:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.596666:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.596670:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.596678:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.596693:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.596699:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000736a6a19/0x4738ba0933b8903e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.596741:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.596746:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.596749:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.597545:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.597554:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.597568:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.597572:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.597578:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.597591:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.597608:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.597617:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.597635:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783562458.598188:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.598195:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.598205:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.598208:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.598213:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.598223:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.598231:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.598238:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.598279:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562458.598288:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562458.598295:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598305:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.598308:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598315:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598328:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598334:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000657ff4d/0x4738ba0933b89045 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598357:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.598362:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598370:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562458.598383:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598392:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598571:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598581:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3ea72d/0x4738ba0933b8904c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.598601:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.598604:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562458.598608:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.599100:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.599555:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.599566:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.599579:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.599583:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.599588:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.599600:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.599609:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.599617:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.599643:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.599677:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.599686:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.599697:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.599703:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.599713:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.599729:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.599737:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36381dd/0x4738ba0933b89053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.599777:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.599781:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.599786:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.600372:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.600380:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.600391:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.600542:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.600549:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.600560:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.600574:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.600583:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.600606:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.600952:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.600961:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.600973:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.601038:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.601050:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.601066:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.601073:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bef5fa6f/0x4738ba0933b8905a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.601095:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.601097:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.601099:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.602773:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.602786:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.602802:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.602806:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.602811:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.602825:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.602836:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.602853:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.602880:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.602908:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.602918:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.602945:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.602952:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.602962:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.603045:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.603054:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235e4cc5/0x4738ba0933b89061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.603076:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.603079:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.603081:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.604722:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.604734:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.604747:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.604751:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.604756:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.604769:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.604777:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.604785:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.604813:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.604860:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.604871:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.604882:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.604886:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.604896:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.604923:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.604930:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3350f6/0x4738ba0933b89068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.604956:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.604958:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.604964:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783562458.605452:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783562458.605474:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.605494:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1783562458.605498:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562458.605503:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.605515:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.605526:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.605535:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.605558:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562458.605584:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562458.605593:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.605604:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562458.605609:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.605618:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.605635:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.605643:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd128ba3/0x4738ba0933b8906f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.605689:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.605692:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.605698:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783562458.606281:0:14806:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1783562458.606447:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14192:x1870200563644160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53568us (53649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.606542:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562458.606775:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14192:1870200563644160:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783562458.606806:0:14192:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1783562458.606938:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14192:1870200563644288:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783562458.606994:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.607180:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.607228:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644288 00000100:00100000:3.0:1783562458.607235:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644288 00000100:00100000:3.0:1783562458.607318:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562458.607329:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14192:x1870200563644288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783562458.607367:0:14804:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1783562458.612924:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14192:x1870200563644288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5589us (5927us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783562458.612944:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562458.613041:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14192:1870200563644288:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783562458.613076:0:14192:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:1.0:1783562458.701612:0:15475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783562458.701616:0:15475:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783562458.701746:0:15475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfd00d46000 00000020:01000004:1.0:1783562458.701763:0:15475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783562458.701776:0:15475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783562458.701790:0:15475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bfcef6499c0) 00000020:00000080:1.0:1783562458.701806:0:15475:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783562458.715157:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783562458.716508:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783562458.717237:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783562458.717583:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783562458.717790:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783562458.718142:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:1.0:1783562458.718240:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:1.0:1783562458.718395:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:1.0:1783562458.718977:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1783562458.720314:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1783562458.720673:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1783562458.720915:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1783562458.721152:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1783562458.721514:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00000020:00000080:1.0:1783562458.722048:0:15475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783562458.722060:0:15475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783562458.722072:0:15475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b8907d 00000020:01000004:1.0:1783562458.722079:0:15475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783562458.722100:0:15475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783562458.722103:0:15475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783562458.722109:0:15475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783562458.722129:0:15475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783562458.722134:0:15475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783562458.729990:0:15475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783562458.730027:0:15475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783562458.730033:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783562458.730035:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562458.730036:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562458.730037:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562458.730038:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562458.730040:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562458.730041:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562458.730043:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562458.730044:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783562458.730048:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783562458.730050:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783562458.730052:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562458.730053:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562458.730054:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562458.730055:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562458.730056:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562458.730057:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562458.730058:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562458.730060:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783562458.730082:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783562458.730107:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562458.730190:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.730304:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.730377:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644416 00000100:00100000:3.0:1783562458.730384:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644416 00000100:00100000:3.0:1783562458.730583:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783562458.730593:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:15475:x1870200563644416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783562458.730628:0:14163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783562458.730631:0:14163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783562458.730635:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783562458.738485:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:15475:x1870200563644416:12345-0@lo:253:mount.lustre.0 Request processed in 7884us (8285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.738500:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783562458.738587:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783562458.738602:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783562458.738605:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783562458.738607:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562458.738608:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562458.738610:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562458.738611:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562458.738613:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562458.738614:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562458.738616:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562458.738617:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783562458.738640:0:15475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfd00d46000 from lustre-OST0001 10000000:01000000:1.0:1783562458.738667:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783562458.738670:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783562458.738678:0:15475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfcf6b90000 local copy 00010000:00010000:1.0:1783562458.738688:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562458.739048:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562458.739087:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.739144:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644544 00000100:00100000:2.0:1783562458.739151:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644544 00000100:00100000:1.0:1783562458.739191:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562458.739202:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783562458.739213:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:15475:x1870200563644544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562458.739621:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:15475:x1870200563644544:12345-0@lo:501:mount.lustre.0 Request processed in 408us (531us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783562458.739630:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783562458.739660:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783562458.739678:0:15475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783562458.739897:0:15475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783562458.739905:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.739925:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562458.739948:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfd00d46000 10000000:01000000:1.0:1783562458.739952:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783562458.739957:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783562458.739960:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783562458.739964:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783562458.739967:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783562458.740064:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.740073:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.740081:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562458.740096:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562458.740197:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.740273:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.740316:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644672 00000100:00100000:3.0:1783562458.740321:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644672 00000100:00100000:3.0:1783562458.740357:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783562458.740365:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:15475:x1870200563644672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562458.740375:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562458.740388:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b8908b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89084 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.740427:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b8908b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89084 expref: 17 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.740438:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b8908b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89084 expref: 17 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.740447:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2400, rc 0) 00000100:00100000:3.0:1783562458.740539:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563644672:12345-0@lo:101:mount.lustre.0 Request processed in 174us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.740555:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783562458.740655:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562458.740667:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.740676:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562458.741580:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783562458.742776:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562458.743356:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783562458.743516:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783562458.743556:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783562458.743602:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783562458.743651:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783562458.743685:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783562458.743751:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783562458.743760:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783562458.743847:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562458.743914:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.743963:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562458.744095:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644800 00000100:00100000:2.0:1783562458.744195:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644800 00000100:00100000:2.0:1783562458.744285:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783562458.744294:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563644800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562458.744691:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563644800:12345-0@lo:501:mount.lustre.0 Request processed in 397us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.744699:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783562458.744789:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562458.744826:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562458.744867:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.744995:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.745186:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563644928 00000100:00100000:3.0:1783562458.745191:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563644928 00000100:00100000:3.0:1783562458.745216:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783562458.745222:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563644928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562458.745554:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563644928:12345-0@lo:503:mount.lustre.0 Request processed in 331us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.745561:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783562458.745669:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563644928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783562458.746576:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783562458.746633:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562458.746673:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.747217:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645056 00000100:00100000:3.0:1783562458.747224:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645056 00000100:00100000:1.0:1783562458.747234:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.747269:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783562458.747277:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563645056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562458.747521:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563645056:12345-0@lo:502:mount.lustre.0 Request processed in 244us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.747529:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783562458.747597:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562458.747760:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783562458.747792:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783562458.747820:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783562458.747845:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783562458.747864:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783562458.747885:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783562458.747920:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783562458.747943:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783562458.747968:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783562458.747987:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562458.748020:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.748051:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc1082c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562458.748192:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645184 00000100:00100000:0.0:1783562458.748197:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645184 00000100:00100000:0.0:1783562458.748233:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783562458.748240:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563645184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562458.748394:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563645184:12345-0@lo:502:mount.lustre.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562458.748434:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783562458.748559:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562458.748622:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1783562458.748632:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1783562458.749764:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562458.749774:0:15477:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783562458.749781:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562458.749783:0:15477:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783562458.749789:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562458.749804:0:15477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bfcef648000) 00000020:00000080:1.0:1783562458.749827:0:15477:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783562458.749833:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783562458.749897:0:15477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfd00d46000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783562458.749907:0:15477:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783562458.749924:0:15477:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b89099 00010000:00010000:1.0:1783562458.752823:0:15477:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783562458.753164:0:15477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1783562458.755516:0:15477:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783562458.757134:0:15477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783562458.757145:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562458.757151:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562458.757154:0:15477:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783562458.757158:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562458.757162:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562458.757164:0:15477:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783562458.757175:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783562458.757177:0:15477:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783562458.757179:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562458.757181:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562458.757183:0:15477:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783562458.757185:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562458.757188:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562458.757190:0:15477:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783562458.757193:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783562458.757253:0:15477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562458.757257:0:15477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562458.757259:0:15477:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783562458.757263:0:15477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783562458.757515:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783562458.757543:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783562458.757598:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.757622:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562458.757655:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfd00d46000 from 1 10000000:01000000:1.0:1783562458.757660:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562458.757696:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.757703:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.757713:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562458.757735:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562458.757807:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.757856:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.757879:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645312 00000100:00100000:3.0:1783562458.757887:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645312 00000100:00100000:3.0:1783562458.757941:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783562458.757953:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:15475:x1870200563645312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562458.757966:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562458.757980:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b890a0 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.758004:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.758016:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.758033:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:3.0:1783562458.758078:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645312:12345-0@lo:101:mount.lustre.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.758086:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783562458.758100:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562458.758114:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.758121:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562458.758713:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783562458.759031:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562458.759323:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783562458.759371:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783562458.759489:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783562458.759499:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783562458.759558:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562458.759602:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.759640:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562458.759645:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645440 00000100:00100000:0.0:1783562458.760186:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645440 00000100:00100000:0.0:1783562458.760346:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783562458.760354:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562458.760636:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645440:12345-0@lo:501:mount.lustre.0 Request processed in 283us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562458.760646:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783562458.760677:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562458.760713:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562458.760753:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.760816:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc10829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562458.760853:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645568 00000100:00100000:2.0:1783562458.760858:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645568 00000100:00100000:2.0:1783562458.760923:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783562458.760932:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562458.761108:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645568:12345-0@lo:503:mount.lustre.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.761115:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783562458.761192:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645568:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783562458.762787:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783562458.762856:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562458.762914:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562458.762955:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562458.762971:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645696 00000100:00100000:1.0:1783562458.762979:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645696 00000100:00100000:1.0:1783562458.763026:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783562458.763037:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562458.763255:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645696:12345-0@lo:502:mount.lustre.0 Request processed in 219us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562458.763263:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783562458.763346:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783562458.763692:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783562458.763750:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783562458.763808:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783562458.763846:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783562458.763875:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783562458.763919:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783562458.763951:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783562458.764005:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783562458.764041:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562458.764085:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562458.764119:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562458.764147:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645824 00000100:00100000:2.0:1783562458.764153:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645824 00000100:00100000:2.0:1783562458.764188:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783562458.764196:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562458.764505:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645824:12345-0@lo:502:mount.lustre.0 Request processed in 308us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.764514:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783562458.764789:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562458.764923:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783562458.764946:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783562458.765917:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562458.765925:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.765927:0:15481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783562458.765932:0:15481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfd00d46000 00000020:00000080:0.0:1783562458.765934:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783562458.765941:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562458.765942:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.765944:0:15481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783562458.765946:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562458.765948:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.765954:0:15481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783562458.765958:0:15481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfd00d46000 00000020:00000080:0.0:1783562458.765959:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783562458.765999:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562458.766001:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.766002:0:15481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783562458.766003:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562458.766005:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.766006:0:15481:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783562458.766008:0:15481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfd00d46000 00000020:00000080:0.0:1783562458.766009:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783562458.766031:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562458.766033:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562458.766034:0:15481:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783562458.766035:0:15481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783562458.766361:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783562458.766385:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562458.766503:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.766515:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562458.766573:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783562458.766576:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfd00d46000 10000000:01000000:3.0:1783562458.766579:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfd00d46000 10000000:01000000:3.0:1783562458.766583:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562458.766589:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfd00d46000 from 1 10000000:01000000:3.0:1783562458.766592:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562458.766623:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.766631:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.766641:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562458.766661:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562458.766724:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.766889:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563645952 00000100:00100000:1.0:1783562458.766897:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563645952 00000100:00100000:3.0:1783562458.766910:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1783562458.766940:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783562458.766952:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563645952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562458.766965:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562458.766978:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682e00/0x4738ba0933b890b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b890ae expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.767012:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682e00/0x4738ba0933b890b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b890ae expref: 19 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.767022:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682e00/0x4738ba0933b890b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b890ae expref: 19 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.767031:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682e00, rc 0) 00000100:00100000:1.0:1783562458.767189:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563645952:12345-0@lo:101:mount.lustre.0 Request processed in 237us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562458.767196:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783562458.769823:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563645952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562458.769850:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.769863:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562458.773953:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1783562458.774647:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562458.775384:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783562458.775485:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783562458.775534:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783562458.775592:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783562458.775634:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783562458.775689:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783562458.775820:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783562458.775874:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783562458.775960:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783562458.776010:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783562458.776052:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783562458.776114:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783562458.776163:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783562458.776214:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783562458.776294:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783562458.776346:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783562458.776438:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783562458.776561:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783562458.776641:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783562458.776709:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783562458.777314:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783562458.777477:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783562458.777543:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783562458.777625:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783562458.777698:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783562458.778299:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783562458.778663:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783562458.778708:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783562458.778829:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783562458.778893:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1783562458.778933:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1783562458.778974:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1783562458.779011:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1783562458.779084:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1783562458.779135:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1783562458.779200:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1783562458.779831:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1783562458.779978:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1783562458.779989:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1783562458.780099:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562458.780172:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.780223:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562458.780285:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646080 00000100:00100000:0.0:1783562458.780294:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646080 00000100:00100000:0.0:1783562458.780370:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783562458.780380:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562458.780639:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646080:12345-0@lo:501:mount.lustre.0 Request processed in 260us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562458.780647:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783562458.780804:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562458.780842:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562458.780885:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.780905:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646208 00000100:00100000:1.0:1783562458.780910:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646208 00000100:00100000:2.0:1783562458.780922:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562458.780952:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783562458.780962:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562458.781113:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646208:12345-0@lo:503:mount.lustre.0 Request processed in 153us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562458.781120:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783562458.781195:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783562458.781764:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562458.781832:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562458.781874:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.781901:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646336 00000100:00100000:2.0:1783562458.781905:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646336 00000100:00100000:2.0:1783562458.781945:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783562458.781952:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562458.782104:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646336:12345-0@lo:502:mount.lustre.0 Request processed in 152us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562458.782111:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783562458.782152:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562458.782166:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562458.782399:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783562458.782509:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783562458.782554:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783562458.782605:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783562458.782646:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783562458.782700:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783562458.782739:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783562458.782777:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783562458.782848:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783562458.782887:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783562458.782916:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783562458.782960:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783562458.782997:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783562458.783030:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783562458.783101:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783562458.783143:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783562458.783179:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783562458.783236:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783562458.783280:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783562458.783319:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783562458.783378:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783562458.783457:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783562458.783514:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783562458.783579:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783562458.783619:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783562458.783658:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783562458.783737:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783562458.783774:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783562458.783802:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783562458.783842:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783562458.783874:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783562458.783903:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783562458.783936:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783562458.783975:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783562458.784022:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783562458.784101:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783562458.784139:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783562458.784184:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783562458.784249:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783562458.784283:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783562458.784320:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562458.784381:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.784443:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562458.784701:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646464 00000100:00100000:1.0:1783562458.784708:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646464 00000100:00100000:1.0:1783562458.784759:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783562458.784768:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562458.784952:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563646464:12345-0@lo:502:mount.lustre.0 Request processed in 185us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562458.784959:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783562458.785044:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563646464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562458.785125:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1783562458.785136:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783562458.786055:0:15486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783562458.786074:0:15486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bfcc5cf99c0) 00000020:00000080:1.0:1783562458.786098:0:15486:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1783562458.786230:0:15486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfd00d46000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562458.786233:0:15486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfd00d46000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562458.786234:0:15486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfd00d46000 3 00010000:00080000:1.0:1783562458.786259:0:15486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfbc95d6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562458.787872:0:15486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1783562458.787967:0:15486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783562458.787999:0:15486:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783562458.788010:0:15486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4738ba0933b890c3 00000100:00080000:1.0:1783562458.788019:0:15486:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562458.788025:0:15486:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bfbc95d6800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562458.788057:0:15486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9ace00 x1870200563646592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562458.788085:0:15486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783562458.788118:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563646592:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783562458.788134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562458.788138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783562458.788141:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562458.788146:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 267 00000100:00080000:1.0:1783562458.788151:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783562458.788154:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcd0d32800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562458.788170:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9ae680 x1870200563646848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783562458.788203:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562458.788222:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563646720:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.788253:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563646848:0@lo:8:kworker.0 00000100:00100000:1.0:1783562458.788292:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.788300:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646592 00000100:00100000:3.0:1783562458.788307:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646592 00000100:00100000:1.0:1783562458.788321:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783562458.788329:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563646976:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.788344:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562458.788346:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563647104:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.788356:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563646592:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783562458.788377:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562458.788396:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646720 00000100:00100000:0.0:1783562458.788421:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646720 00000100:00100000:1.0:1783562458.788427:0:14171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783562458.788433:0:14171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783562458.788442:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562458.788453:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562458.788472:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3274:x1870200563646720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562458.788531:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3274:x1870200563646720:12345-0@lo:400:kworker.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562458.788538:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783562458.788544:0:14169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1783562458.788597:0:14169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4738ba0933b890ca 00000004:00100000:3.0:1783562458.788613:0:14169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783562458.788650:0:14169:0:(import.c:65:import_set_state_nolock()) ffff9bfbc1cc9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562458.788689:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1870200563646592:12345-0@lo:38:llog_process_th.0 Request processed in 334us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.788696:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562458.788703:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.788711:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646976 00000100:00100000:3.0:1783562458.788715:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646976 00000100:00100000:3.0:1783562458.788735:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647104 00000100:00100000:3.0:1783562458.788743:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647104 00010000:00080000:0.0:1783562458.788748:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef9ace00 x1870200563646592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562458.788758:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562458.788767:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783562458.788774:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783562458.788778:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783562458.788781:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783562458.788786:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563646592:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783562458.788877:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562458.788883:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563646976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.788916:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563646976:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.788923:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783562458.788927:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef9ad500 x1870200563646976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562458.788937:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562458.788942:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563646976:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.788948:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563647104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562458.788957:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563646720:0@lo:400:kworker.0 00000100:00100000:3.0:1783562458.789002:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563647104:12345-0@lo:400:kworker.0 Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.789008:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783562458.789044:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcef9af480 x1870200563647104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562458.789053:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563647104:0@lo:400:kworker.0 00000040:00080000:1.0:1783562458.789132:0:15486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1783562458.789298:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563646848 00000100:00100000:3.0:1783562458.789303:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563646848 00000100:00100000:3.0:1783562458.789326:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562458.789331:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3271:x1870200563646848:12345-0@lo:8:kworker.0 00000020:01000000:2.0:1783562458.789509:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:3.0:1783562458.789515:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3271:x1870200563646848:12345-0@lo:8:kworker.0 Request processed in 180us (813us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783562458.789523:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562458.789535:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783562458.789540:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 10000000:01000000:2.0:1783562458.789544:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:1.0:1783562458.789544:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783562458.789548:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563646848:0@lo:8:kworker.0 00010000:00010000:2.0:1783562458.789568:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562458.789580:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783562458.789625:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783562458.789627:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783562458.789628:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562458.789629:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562458.789631:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562458.789632:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562458.789633:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562458.789635:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562458.789636:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562458.789640:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1783562458.789642:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783562458.789644:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783562458.789648:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562458.789649:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562458.789649:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562458.789650:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562458.789651:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562458.789652:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562458.789653:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783562458.789667:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783562458.789677:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563647232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783562458.789705:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562458.789730:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6f0d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.789873:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647232 00000100:00100000:3.0:1783562458.789878:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647232 00000100:00100000:3.0:1783562458.789907:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783562458.789914:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:15475:x1870200563647232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783562458.789934:0:14163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783562458.790054:0:14163:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783562458.800860:0:14163:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783562458.800873:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783562458.800894:0:14185:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783562458.800899:0:14185:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783562458.800922:0:14185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.800942:0:14185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.800951:0:14185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.800990:0:14185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.801005:0:14185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 19 pid: 14161 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562458.801021:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563647360:0@lo:104: 00000100:00100000:0.0:1783562458.801088:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.801134:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647360 00000100:00100000:0.0:1783562458.801134:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562458.801142:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647360 00000100:00100000:3.0:1783562458.801194:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562458.801204:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563647360:12345-0@lo:104: 00010000:00010000:3.0:1783562458.801226:0:14153:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801281:0:14153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783562458.801287:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:14185:x1870200563647360:12345-0@lo:104: Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562458.801293:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562458.801303:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14185:1870200563647360:0@lo:104: 00010000:00010000:1.0:1783562458.801323:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562458.801323:0:14185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801330:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801338:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562458.801341:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801350:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562458.801357:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562458.801369:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562458.801397:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801423:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562458.801449:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801456:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c600/0x4738ba0933b88f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88fa4 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562458.801483:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.801485:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562458.801486:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562458.801488:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563647488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562458.801515:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562458.801547:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647488 00000100:00100000:3.0:1783562458.801551:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647488 00010000:00010000:3.0:1783562458.801568:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 20 pid: 14161 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562458.801587:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562458.801593:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+20:3273:x1870200563647488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562458.801601:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562458.801605:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 20 pid: 14161 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801622:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 20 pid: 14161 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801631:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336000/0x4738ba0933b88fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88f9d expref: 20 pid: 14161 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801640:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801651:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783562458.801662:0:14156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001637584s 00010000:00010000:3.0:1783562458.801665:0:14156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801670:0:14156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801674:0:14156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801677:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801681:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562458.801684:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801688:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801703:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562458.801709:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562458.801736:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3273:x1870200563647488:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562458.801738:0:14185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562458.801743:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783562458.801749:0:14185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562458.801758:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb9600/0x4738ba0933b890d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562458.801772:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563647488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562458.805543:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:15475:x1870200563647232:12345-0@lo:253:mount.lustre.0 Request processed in 15622us (15829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562458.805555:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783562458.805596:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e84b51d8-00f8-4fc5-9608-af3d9dda1905:15475:1870200563647232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783562458.805612:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783562458.805616:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783562458.805618:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783562458.805619:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562458.805620:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562458.805622:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562458.805623:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562458.805625:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562458.805626:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562458.805628:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783562458.805642:0:15475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783562458.805997:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562458.806144:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562458.806308:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562458.806520:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562458.806670:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562458.806865:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783562458.807598:0:15475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783562458.828283:0:15475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783562458.828293:0:15475:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783562458.828337:0:15475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783562458.828489:0:15475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783562458.828514:0:15475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783562458.828543:0:15475:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783562459.190604:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562460.214597:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783562460.342464:0:14166:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783562460.342470:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfcf6881000 from 8 10000000:01000000:1.0:1783562460.342473:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783562460.342512:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562460.342524:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562460.342535:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562460.342566:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563647616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562460.342636:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562460.342686:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562460.342690:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647616 00000100:00100000:2.0:1783562460.342697:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647616 00000100:00100000:2.0:1783562460.342743:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783562460.342752:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563647616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562460.342773:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562460.342787:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1d000/0x4738ba0933b890df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b890d8 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562460.342809:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1d000/0x4738ba0933b890df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b890d8 expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562460.342816:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1d000/0x4738ba0933b890df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b890d8 expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562460.342824:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d000, rc 0) 00000100:00100000:2.0:1783562460.342859:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563647616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562460.342866:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783562460.342885:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563647616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562460.342899:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562460.342907:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562460.342951:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563647744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783562460.342981:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562460.342998:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783562460.343230:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647744 00000100:00100000:3.0:1783562460.343236:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647744 00000100:00100000:3.0:1783562460.343270:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783562460.343279:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563647744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783562460.343293:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783562460.343309:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783562460.343312:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783562460.343424:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563647744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562460.343444:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783562460.343470:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563647744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783562460.343538:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783562460.343546:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562460.343554:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562460.407713:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562460.407722:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562460.408740:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1783562460.408751:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783562461.239532:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562461.372979:0:15842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783562462.263427:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562462.510726:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.510938:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553180928 00000100:00100000:2.0:1783562462.510949:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553180928 00000100:00100000:2.0:1783562462.510999:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:2.0:1783562462.511007:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1870200553180928:12345-192.168.204.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783562462.511098:0:14161:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 876f48e4-b384-4b8b-bbd5-8ded2a13ee69@192.168.204.4@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1783562462.511130:0:14161:0:(genops.c:1406:class_connect()) connect: client 876f48e4-b384-4b8b-bbd5-8ded2a13ee69, cookie 0x4738ba0933b890e6 00000100:00080000:2.0:1783562462.511269:0:14161:0:(import.c:65:import_set_state_nolock()) ffff9bfcf7133000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562462.511347:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+5:2360:x1870200553180928:12345-192.168.204.4@tcp:250:mount.lustre.0 Request processed in 339us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.511354:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:1.0:1783562462.516669:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.516810:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181056 00000100:00100000:3.0:1783562462.516822:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181056 00000100:00100000:3.0:1783562462.516926:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:3.0:1783562462.516936:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+5:13693:x1870200553181056:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783562462.516952:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562462.516972:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b890ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21580 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.517001:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b890ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21580 expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.517014:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b890ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21580 expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.517024:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2200, rc 0) 00000100:00100000:3.0:1783562462.517129:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+6:13693:x1870200553181056:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 194us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562462.517160:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:1.0:1783562462.520590:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.520670:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181184 00000100:00100000:2.0:1783562462.520680:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181184 00000100:00100000:2.0:1783562462.521012:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:2.0:1783562462.521024:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+6:13693:x1870200553181184:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783562462.521515:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+6:13693:x1870200553181184:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 491us (933us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783562462.521524:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:0.0:1783562462.523659:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.523716:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181312 00000100:00100000:3.0:1783562462.523727:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181312 00000100:00100000:3.0:1783562462.523859:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:3.0:1783562462.523872:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfd00de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+6:13693:x1870200553181312:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783562462.523887:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562462.523906:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b890f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21587 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.524107:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b890f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21587 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.524120:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b890f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21587 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.524130:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3000, rc 0) 00000100:00100000:3.0:1783562462.524203:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfd00de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+7:13693:x1870200553181312:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 334us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562462.524211:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:3.0:1783562462.527252:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.527347:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181440 00000100:00100000:2.0:1783562462.527358:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181440 00000100:00100000:2.0:1783562462.527515:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:2.0:1783562462.527527:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+7:13693:x1870200553181440:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783562462.527860:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13693:x1870200553181440:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 334us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.527870:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:0.0:1783562462.531496:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.536303:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181568 00000100:00100000:3.0:1783562462.536319:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181568 00000100:00100000:2.0:1783562462.537330:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:2.0:1783562462.537342:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13693:x1870200553181568:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783562462.538289:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13693:x1870200553181568:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 944us (6801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.538305:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:0.0:1783562462.541236:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.542590:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181696 00000100:00100000:2.0:1783562462.542607:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181696 00000100:00100000:2.0:1783562462.542704:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:2.0:1783562462.542715:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13711:x1870200553181696:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562462.543092:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13711:x1870200553181696:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 378us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.543101:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:3.0:1783562462.562242:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562462.562320:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181824 00000100:00100000:0.0:1783562462.562369:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181824 00000100:00100000:0.0:1783562462.562500:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:0.0:1783562462.562513:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13711:x1870200553181824:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562462.563087:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13711:x1870200553181824:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 576us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562462.563095:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:0.0:1783562462.567028:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562462.567136:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553181952 00000100:00100000:1.0:1783562462.567159:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553181952 00000100:00100000:1.0:1783562462.567226:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:1.0:1783562462.567238:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:13693:x1870200553181952:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783562462.567345:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562462.567374:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b890fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c215b1 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562462.567470:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b890fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b1 expref: 9 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562462.567615:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b890fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b1 expref: 9 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562462.567627:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683800, rc 0) 00000100:00100000:1.0:1783562462.567695:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+9:13693:x1870200553181952:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 459us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562462.567704:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:2.0:1783562462.570954:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562462.571122:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182080 00000100:00100000:0.0:1783562462.571135:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182080 00000100:00100000:0.0:1783562462.571230:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:0.0:1783562462.571242:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+9:13693:x1870200553182080:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783562462.571283:0:14164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783562462.571321:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783562462.571325:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783562462.571329:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783562462.571331:0:14164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1783562462.573245:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+9:13693:x1870200553182080:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 1992us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562462.573269:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:1.0:1783562462.577975:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.578051:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182208 00000100:00100000:2.0:1783562462.578079:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182208 00000100:00100000:2.0:1783562462.578159:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:2.0:1783562462.578172:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+9:13693:x1870200553182208:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783562462.578194:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562462.578217:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c215b8 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562462.578255:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562462.578268:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562462.578280:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c400, rc 0) 00000100:00100000:2.0:1783562462.578346:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13693:x1870200553182208:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 177us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.578353:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:2.0:1783562462.580134:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562462.580238:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182336 00000100:00100000:0.0:1783562462.580247:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182336 00000100:00100000:0.0:1783562462.580440:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:0.0:1783562462.580460:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13693:x1870200553182336:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562462.580793:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13693:x1870200553182336:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 343us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562462.580801:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:0.0:1783562462.583638:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.583763:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182464 00000100:00100000:2.0:1783562462.583773:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182464 00000100:00100000:2.0:1783562462.583826:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:2.0:1783562462.583835:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13693:x1870200553182464:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783562462.584155:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13693:x1870200553182464:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 319us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.584165:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:1.0:1783562462.586533:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.586796:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182592 00000100:00100000:2.0:1783562462.586812:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182592 00000100:00100000:2.0:1783562462.586889:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:2.0:1783562462.586917:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13716:x1870200553182592:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562462.587233:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13716:x1870200553182592:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 318us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.587242:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:0.0:1783562462.589269:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.589445:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182720 00000100:00100000:2.0:1783562462.589457:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182720 00000100:00100000:2.0:1783562462.590087:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:2.0:1783562462.590102:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13716:x1870200553182720:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562462.590479:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13716:x1870200553182720:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 380us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.590497:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:0.0:1783562462.595893:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.597474:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182848 00000100:00100000:3.0:1783562462.597490:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182848 00000100:00100000:3.0:1783562462.597561:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562462.597572:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1870200553182848:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783562462.597630:0:14169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1783562462.597696:0:14169:0:(genops.c:1406:class_connect()) connect: client a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc, cookie 0x4738ba0933b89109 00000004:00100000:3.0:1783562462.597736:0:14169:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783562462.597743:0:14169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1783562462.614727:0:14169:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562462.614843:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2360:x1870200553182848:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 17270us (18965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562462.614857:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562462.619616:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562462.619735:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562462.619885:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553182976 00000100:00100000:0.0:1783562462.619899:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553182976 00000100:00100000:0.0:1783562462.619994:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183104 00000100:00100000:0.0:1783562462.619999:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183104 00000100:00100000:0.0:1783562462.620034:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562462.620046:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:0:x1870200553182976:12345-192.168.204.4@tcp:41:mount.lustre.0 00000100:00080000:2.0:1783562462.620054:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1783562462.620112:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783562462.620186:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:3.0:1783562462.620200:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:13693:x1870200553183104:12345-192.168.204.4@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783562462.620218:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:0:x1870200553182976:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 173us (614us total) trans 0 rc 0/0 00000004:00000024:3.0:1783562462.620222:0:15489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783562462.620231:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562462.620263:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13693:x1870200553183104:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 67us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562462.620272:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:0.0:1783562462.625226:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.625529:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183232 00000100:00100000:3.0:1783562462.625542:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183232 00000100:00100000:0.0:1783562462.625712:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562462.625727:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13693:x1870200553183232:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783562462.625843:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13693:x1870200553183232:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 119us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562462.625852:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:2.0:1783562462.627994:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.628043:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562462.628094:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562462.628187:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183616 00000100:00100000:0.0:1783562462.628214:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183616 00000100:00100000:0.0:1783562462.628278:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:0.0:1783562462.628290:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13693:x1870200553183616:12345-192.168.204.4@tcp:33:mount.lustre.0 00000100:00100000:1.0:1783562462.628653:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183360 00000100:00100000:1.0:1783562462.628668:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183360 00000100:00100000:1.0:1783562462.628706:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183488 00000100:00100000:1.0:1783562462.628710:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183488 00000100:00100000:1.0:1783562462.628726:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562462.628734:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553183360:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783562462.628769:0:14803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1783562462.628820:0:14803:0:(genops.c:1406:class_connect()) connect: client a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc, cookie 0x4738ba0933b89110 00002000:00100000:1.0:1783562462.628836:0:14803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc/ffff9bfbc95d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783562462.628875:0:14803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783562462.629160:0:14803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00080000:3.0:1783562462.629181:0:14172:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 812us 00000100:00080000:1.0:1783562462.629200:0:14803:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562462.629498:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2360:x1870200553183360:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 762us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562462.629510:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562462.629535:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562462.629541:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553183488:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783562462.629561:0:14803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1783562462.629584:0:14803:0:(genops.c:1406:class_connect()) connect: client a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc, cookie 0x4738ba0933b89117 00002000:00100000:1.0:1783562462.629591:0:14803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc/ffff9bfbc95d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783562462.629611:0:14803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783562462.629932:0:14803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783562462.629947:0:14803:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562462.629982:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2360:x1870200553183488:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 441us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562462.629987:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000004:00200000:2.0:1783562462.638756:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783562462.639080:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13693:x1870200553183616:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 10786us (11091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562462.639098:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:2.0:1783562462.731573:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562462.732890:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183744 00000100:00100000:3.0:1783562462.732902:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183744 00000100:00100000:3.0:1783562462.732969:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562462.732979:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13737:x1870200553183744:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:3.0:1783562462.733001:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562462.733027:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b8911e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c215e2 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733185:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733198:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733229:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562462.733554:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783562462.733559:0:15489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562462.733654:0:15489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733684:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b8911e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e2 expref: 8 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733703:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e2 expref: 7 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562462.733711:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:3.0:1783562462.733714:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562462.733718:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3c00, rc 0) 00000100:00100000:3.0:1783562462.733795:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:13737:x1870200553183744:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 816us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562462.733802:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:1.0:1783562463.286654:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562463.606986:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783562463.607021:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563647872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562463.607118:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562463.607265:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563647872 00000100:00100000:3.0:1783562463.607274:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563647872 00000100:00100000:3.0:1783562463.607346:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562463.607358:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563647872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562463.607392:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562463.607473:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563647872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562463.607490:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562463.607562:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563647872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783562463.607627:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1783562463.672391:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000001:00080000:2.0:1783562463.672585:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1783562463.672650:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1783562464.118960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1783562464.118970:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563648000:0@lo:400:kworker.0 00000100:00080000:0.0:1783562464.118971:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783562464.118977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783562464.118990:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcd0d32800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562464.119015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcf664aa00 x1870200563648256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783562464.119070:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562464.119169:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563648640:0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119206:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562464.119220:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563648512:0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119246:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648000 00000100:00100000:2.0:1783562464.119256:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648000 00000100:00100000:0.0:1783562464.119260:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562464.119302:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563648128:0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119327:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783562464.119339:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562464.119344:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3275:x1870200563648000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562464.119386:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562464.119392:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563648384:0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119451:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3275:x1870200563648000:12345-0@lo:400:kworker.0 Request processed in 113us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.119460:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562464.119466:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783562464.119495:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648640 00000100:00100000:0.0:1783562464.119501:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648640 00000100:00100000:2.0:1783562464.119517:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648512 00000100:00100000:2.0:1783562464.119522:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648512 00000100:00100000:2.0:1783562464.119551:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648384 00000100:00100000:2.0:1783562464.119554:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648384 00000100:00100000:0.0:1783562464.119557:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562464.119567:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563648640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119578:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562464.119588:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563648512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562464.119606:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563648640:12345-0@lo:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.119612:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562464.119628:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562464.119637:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563648512:12345-0@lo:400:kworker.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.119638:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563648384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119651:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562464.119678:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563648384:12345-0@lo:400:kworker.0 Request processed in 43us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.119685:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562464.119705:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563648640:0@lo:400:kworker.0 00000100:00100000:2.0:1783562464.119720:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563648000:0@lo:400:kworker.0 00000100:00100000:0.0:1783562464.119722:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648128 00000100:00100000:0.0:1783562464.119727:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648128 00000100:00100000:0.0:1783562464.119752:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562464.119760:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563648128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783562464.119762:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562464.119792:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563648128:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.119798:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562464.119822:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563648512:0@lo:400:kworker.0 00000100:00100000:0.0:1783562464.119841:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563648384:0@lo:400:kworker.0 00000100:00100000:0.0:1783562464.119848:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783562464.119859:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563648128:0@lo:400:kworker.0 00000100:00100000:1.0:1783562464.119952:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563648256:0@lo:8:kworker.0 00000100:00100000:1.0:1783562464.119985:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562464.120428:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648256 00000100:00100000:3.0:1783562464.120435:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648256 00000100:00100000:3.0:1783562464.120462:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783562464.120470:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3271:x1870200563648256:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783562464.120504:0:14806:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:3.0:1783562464.120543:0:14806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b8912c 00002000:00100000:3.0:1783562464.120560:0:14806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bfbc1ccd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783562464.120565:0:14806:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783562464.120568:0:14806:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783562464.120942:0:14806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783562464.120977:0:14806:0:(import.c:65:import_set_state_nolock()) ffff9bfbc1cc8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562464.121042:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563648256:12345-0@lo:8:kworker.0 Request processed in 572us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562464.121052:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783562464.121441:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcf664aa00 x1870200563648256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783562464.121458:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783562464.121469:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783562464.121476:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783562464.121478:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783562464.121494:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783562464.121499:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563648256:0@lo:8:kworker.0 00000004:00080000:3.0:1783562464.121563:0:14194:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783562464.121585:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14194:1870200563648896:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783562464.121622:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562464.121643:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc585ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562464.121663:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563648768:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1783562464.121705:0:14193:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000100:00100000:0.0:1783562464.121705:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562464.121735:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562464.121741:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563649024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783562464.121764:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562464.121796:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648896 00000100:00100000:0.0:1783562464.121808:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648896 00000100:00100000:0.0:1783562464.121852:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649024 00000100:00100000:0.0:1783562464.121855:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649024 00000100:00100000:0.0:1783562464.121872:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562464.121879:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14194:x1870200563648896:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783562464.122152:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563648768 00000100:00100000:2.0:1783562464.122157:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563648768 00000100:00100000:2.0:1783562464.122193:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1783562464.122200:0:14193:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:2.0:1783562464.122201:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3272:x1870200563648768:12345-0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1783562464.122209:0:14193:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00002000:00000024:2.0:1783562464.122229:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562464.122289:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3272:x1870200563648768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.122297:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783562464.122337:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783562464.122390:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1a9c00 x1870200563648768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562464.122443:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563648768:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783562464.122450:0:14193:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783562464.123073:0:14193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273379668705ns, next at 0ns, rc = 0 00002000:00080000:0.0:1783562464.125056:0:14804:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783562464.125067:0:14804:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783562464.125074:0:14804:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1783562464.140009:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.140026:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140045:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.140050:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.140057:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140081:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140093:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140102:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140127:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562464.140145:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562464.140159:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140168:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.140173:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140184:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140204:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140212:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.140239:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.140241:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.140244:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.141041:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.141052:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.141063:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.141067:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.141072:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.141099:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.141108:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.141116:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.141142:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.141212:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.141222:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.141234:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.141240:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.141251:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.141271:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.141280:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b8913a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.141303:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.141307:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.141310:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.143790:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.143804:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.143823:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.143827:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.143834:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.143850:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.143860:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.143881:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.143904:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562464.144426:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.144435:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144446:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.144450:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.144454:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144466:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144476:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144485:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144503:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562464.144516:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562464.144524:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144539:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.144545:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144555:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144577:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144586:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89141 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144610:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562464.144614:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144622:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.144626:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144634:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144646:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144662:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.144681:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.144684:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.144687:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.144724:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.145317:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.145327:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145339:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.145343:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.145348:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145375:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145388:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145397:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145455:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562464.145466:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562464.145479:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145488:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.145494:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145503:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145520:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145527:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8914f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.145545:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.145547:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.145549:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.146192:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.146290:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146304:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.146308:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.146314:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146340:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146352:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146372:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146392:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562464.146485:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562464.146492:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146501:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.146507:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146516:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146531:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146539:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.146566:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.146569:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.146571:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.147563:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.147576:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147588:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.147593:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.147599:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147612:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147621:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147629:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147648:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562464.147661:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562464.147667:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147691:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562464.147696:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147705:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147720:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147728:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b8915d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.147751:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.147754:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.147756:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.148321:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.148328:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.148337:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.148341:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.148345:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.151552:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.151595:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.151603:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783562464.151691:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00010000:00010000:0.0:1783562464.151699:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.151822:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.151833:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.151844:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.151849:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.151859:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.151893:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.151902:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.151930:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.152019:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.152022:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.152592:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.152603:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.152618:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.152623:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.152632:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.152647:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.152656:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.152664:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.152707:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.152859:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.152868:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.152890:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.152896:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.152905:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.152922:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.152930:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b8916b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.152956:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.152959:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.152962:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.153759:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.153768:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.153781:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.153785:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.153790:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.153803:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.153812:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.153819:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.153842:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.154066:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.154074:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.154085:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.154090:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.154101:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.154116:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.154125:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.154145:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.154147:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.154149:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783562464.154727:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000004:00080000:1.0:1783562464.154746:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1783562464.155243:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.155483:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.155503:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.155518:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.155525:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.155540:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.155549:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.155556:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.155579:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.155809:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.155817:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.155828:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.155833:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.155857:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.155875:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.155883:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89179 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.155908:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.155911:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.155913:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.156367:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.156374:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.156384:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.156387:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.156391:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.156436:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.156446:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.156460:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.156475:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.156499:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.156518:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.156528:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.156532:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.156548:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.156561:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.156569:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89180 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.156587:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.156590:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.156593:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.157256:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.157264:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157274:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.157277:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.157282:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157292:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157302:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157310:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157475:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562464.157942:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.157949:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157964:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.157967:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.157971:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157981:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157989:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.157997:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158030:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562464.158039:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158050:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.158069:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158080:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158097:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158117:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158137:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.158141:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158443:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.158448:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158458:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158471:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.158480:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.158482:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.158486:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.158569:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.158599:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783562464.158605:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b8918e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562464.160397:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.160483:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.160501:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.160505:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.160511:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.160539:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.160550:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.160558:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.160580:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.160600:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.160729:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.160742:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.160756:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.160768:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.160795:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.160803:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.160834:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.160837:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.160840:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.161584:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.161593:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.161606:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.161610:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.161616:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.161628:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.161638:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.161984:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.162009:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.162102:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.162109:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.162117:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.162121:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.162129:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.162145:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.162159:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b8919c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.162182:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.162184:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.162186:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.163257:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.163268:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.163284:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.163288:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.163294:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.163307:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.163319:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.163326:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.163349:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.163447:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.163456:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.163466:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.163471:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.163485:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.163504:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.163520:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b891a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.163545:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.163548:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.163550:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.164213:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.164222:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.164238:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.164241:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.164246:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.164256:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.164266:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.164273:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.164296:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.164511:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.164518:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.164526:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.164530:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.164538:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.164553:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.164561:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b891aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.164579:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.164581:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.164583:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.165247:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.165254:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165263:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.165267:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.165271:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165283:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165303:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165310:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165385:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562464.165854:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.165860:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165868:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.165871:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.165874:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165883:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165890:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.165897:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166120:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562464.166128:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166136:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.166141:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166150:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166167:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166175:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b891b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166195:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.166198:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166212:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.166215:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166221:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166231:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.166239:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.166241:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.166242:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562464.166339:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783562464.166344:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b891b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.166374:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.167009:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.167014:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167020:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.167022:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.167025:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167032:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167038:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167046:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167100:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562464.167547:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.167553:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167566:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.167569:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.167573:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167582:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167590:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167597:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.167680:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562464.167688:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.167697:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.167701:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.167710:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.167786:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.167810:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.168155:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.168165:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b891bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.168175:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.168184:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.168189:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.168190:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.168192:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.168194:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562464.168199:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562464.168223:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562464.168228:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562464.168237:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562464.168256:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562464.168264:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b891c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562464.168288:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562464.168290:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562464.168293:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.168617:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.168624:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.168633:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.168636:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.168641:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.168651:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.168669:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.168676:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.168777:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.168986:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.168992:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.169000:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.169004:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.169013:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.169025:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.169032:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b891cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.169046:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.169048:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.169049:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.169336:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.169342:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.169350:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.169353:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.169369:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.169380:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.169388:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.169395:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.169495:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.169612:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.169620:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.169630:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.169635:0:15964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.169643:0:15964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.169657:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.169665:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081c34817/0x4738ba0933b891d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.169686:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.169688:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.169690:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.170037:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.170043:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170051:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.170054:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.170058:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170066:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170075:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170082:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170105:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.170286:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.170293:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.170315:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.170319:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.170328:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.170340:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.170348:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b891db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.170376:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.170379:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.170382:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.170596:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.170602:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170610:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.170621:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.170626:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170636:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170644:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170649:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.170687:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562464.170938:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562464.170945:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.170952:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698ec00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562464.170955:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.170963:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.170975:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.170982:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d53086/0x4738ba0933b891e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562464.170998:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.171000:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562464.171002:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562464.171133:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562464.171137:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.171143:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1783562464.171145:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562464.171147:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.171154:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.171158:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.171167:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.171179:0:14804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562464.171211:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562464.171227:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.171238:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698fa00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562464.171242:0:15964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.171253:0:15964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.171274:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.171282:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8758925/0x4738ba0933b891e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.171301:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.171304:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562464.171308:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783562464.171326:0:14804:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1783562464.171471:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14194:x1870200563648896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 49587us (49843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.171483:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562464.171517:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783562464.171531:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563649024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783562464.171543:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14194:1870200563648896:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783562464.171564:0:14194:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783562464.171627:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14194:1870200563649152:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783562464.171670:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562464.171715:0:14806:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783562464.171726:0:14806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783562464.171727:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c55180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562464.171965:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649152 00000100:00100000:2.0:1783562464.171973:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649152 00000100:00100000:0.0:1783562464.172099:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783562464.172108:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:14194:x1870200563649152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783562464.172138:0:15965:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1783562464.186089:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:14194:x1870200563649152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13973us (14409us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783562464.186108:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562464.186135:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14194:1870200563649152:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783562464.186159:0:14194:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:1.0:1783562464.195959:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1783562464.196033:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783562464.196039:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563649024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 24506us (74266us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783562464.196053:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:2.0:1783562464.196134:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcef1a8e00/2, rc 0, transno 8589934593 00000100:00100000:2.0:1783562464.196142:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563649024:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1783562464.312241:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562464.331375:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.331517:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553183872 00000100:00100000:2.0:1783562464.331530:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553183872 00000100:00100000:2.0:1783562464.331643:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:2.0:1783562464.331656:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13802:x1870200553183872:12345-192.168.204.4@tcp:41:lfs.0 00000004:00000024:2.0:1783562464.331722:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783562464.331834:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:13802:x1870200553183872:12345-192.168.204.4@tcp:41:lfs.0 Request processed in 181us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.331843:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00080000:0.0:1783562464.331938:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562464.335497:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562464.335591:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184000 00000100:00100000:3.0:1783562464.335611:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184000 00000100:00080000:0.0:1783562464.335728:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562464.335740:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:3.0:1783562464.335759:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:13802:x1870200553184000:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:3.0:1783562464.335824:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562464.335956:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:13802:x1870200553184000:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 203us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562464.335965:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:3.0:1783562464.338495:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.338622:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184128 00000100:00100000:2.0:1783562464.338654:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184128 00000100:00100000:2.0:1783562464.338758:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:2.0:1783562464.338773:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:13802:x1870200553184128:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:2.0:1783562464.338808:0:14808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562464.338924:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:13802:x1870200553184128:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 153us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.338932:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00080000:0.0:1783562464.339203:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562464.431531:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.434501:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184256 00000100:00100000:2.0:1783562464.434528:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184256 00000100:00100000:2.0:1783562464.434648:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:2.0:1783562464.434661:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:13836:x1870200553184256:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783562464.434686:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562464.434714:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b891f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c215e9 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.434759:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b891f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e9 expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.434773:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b891f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e9 expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.434784:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d600, rc 0) 00000100:00100000:2.0:1783562464.434882:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184256:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 224us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.434890:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:1.0:1783562464.438847:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.438978:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184384 00000100:00100000:0.0:1783562464.438994:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184384 00000100:00100000:0.0:1783562464.439068:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:0.0:1783562464.439081:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184384:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562464.441416:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184384:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 2320us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.441443:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:2.0:1783562464.444157:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562464.444311:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184512 00000100:00100000:1.0:1783562464.444322:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184512 00000100:00100000:1.0:1783562464.444476:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:1.0:1783562464.444505:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184512:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783562464.444833:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184512:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 330us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562464.444842:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:1.0:1783562464.450391:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.450616:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184640 00000100:00100000:0.0:1783562464.450630:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184640 00000100:00100000:0.0:1783562464.450699:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:0.0:1783562464.450710:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc66ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13841:x1870200553184640:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562464.451146:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc66ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13841:x1870200553184640:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 436us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.451154:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:3.0:1783562464.460604:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562464.461108:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184768 00000100:00100000:1.0:1783562464.461120:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184768 00000100:00100000:1.0:1783562464.461193:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:1.0:1783562464.461206:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13841:x1870200553184768:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783562464.461579:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13841:x1870200553184768:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 374us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562464.461589:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:2.0:1783562464.468072:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.469282:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553184896 00000100:00100000:0.0:1783562464.469296:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553184896 00000100:00100000:0.0:1783562464.469380:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:0.0:1783562464.469391:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13836:x1870200553184896:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562464.469506:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562464.469526:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698e400/0x4738ba0933b891f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21613 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.469560:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698e400/0x4738ba0933b891f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21613 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.469571:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698e400/0x4738ba0933b891f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21613 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.469580:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e400, rc 0) 00000100:00100000:0.0:1783562464.469647:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13836:x1870200553184896:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 258us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.469654:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:2.0:1783562464.472992:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562464.473061:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185024 00000100:00100000:1.0:1783562464.473073:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185024 00000100:00100000:1.0:1783562464.473134:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:1.0:1783562464.473145:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13836:x1870200553185024:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783562464.473174:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783562464.473205:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783562464.473210:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783562464.473213:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783562464.473215:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783562464.475085:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13836:x1870200553185024:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 1934us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562464.475098:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:3.0:1783562464.478650:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.478744:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185152 00000100:00100000:0.0:1783562464.478760:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185152 00000100:00100000:0.0:1783562464.478864:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:0.0:1783562464.478880:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13836:x1870200553185152:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562464.478907:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562464.478940:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2161a expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.478993:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.479009:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562464.479022:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f200, rc 0) 00000100:00100000:0.0:1783562464.479163:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13836:x1870200553185152:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 229us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.479171:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:2.0:1783562464.482455:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562464.482552:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185280 00000100:00100000:1.0:1783562464.482568:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185280 00000100:00100000:1.0:1783562464.482654:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:1.0:1783562464.482668:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13836:x1870200553185280:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783562464.483026:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13836:x1870200553185280:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 360us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562464.483035:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:3.0:1783562464.485617:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.485719:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185408 00000100:00100000:0.0:1783562464.485738:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185408 00000100:00100000:0.0:1783562464.485820:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:0.0:1783562464.485830:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13836:x1870200553185408:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783562464.486197:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13836:x1870200553185408:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 366us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.486205:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:3.0:1783562464.493700:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562464.493908:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185536 00000100:00100000:1.0:1783562464.493926:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185536 00000100:00100000:1.0:1783562464.494011:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:1.0:1783562464.494028:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13845:x1870200553185536:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783562464.494475:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13845:x1870200553185536:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 448us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562464.494487:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:2.0:1783562464.497108:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.497202:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185664 00000100:00100000:0.0:1783562464.497216:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185664 00000100:00100000:0.0:1783562464.497287:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:0.0:1783562464.497317:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13845:x1870200553185664:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562464.497695:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13845:x1870200553185664:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 380us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.497705:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:3.0:1783562464.500979:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.501480:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185792 00000100:00100000:2.0:1783562464.501503:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185792 00000100:00100000:2.0:1783562464.501651:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:2.0:1783562464.501662:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1870200553185792:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783562464.501713:0:14169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 56505833-5a6d-4dcf-a09f-d3837b93b675@192.168.204.4@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1783562464.501775:0:14169:0:(genops.c:1406:class_connect()) connect: client 56505833-5a6d-4dcf-a09f-d3837b93b675, cookie 0x4738ba0933b89205 00000004:00100000:2.0:1783562464.501832:0:14169:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783562464.502201:0:14169:0:(import.c:65:import_set_state_nolock()) ffff9bfcd345b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562464.502311:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2360:x1870200553185792:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 648us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.502319:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562464.508579:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562464.508671:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562464.508800:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553185920 00000100:00100000:2.0:1783562464.508813:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186048 00000100:00100000:0.0:1783562464.508813:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553185920 00000100:00100000:2.0:1783562464.508821:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186048 00000100:00100000:2.0:1783562464.508892:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562464.508905:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+7:13836:x1870200553186048:12345-192.168.204.4@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783562464.508923:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562464.508932:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+7:0:x1870200553185920:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783562464.508952:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1783562464.508952:0:14170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783562464.509032:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+7:13836:x1870200553186048:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.509042:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00080000:1.0:1783562464.509061:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562464.509083:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:0:x1870200553185920:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 151us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.509091:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1783562464.511089:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562464.511148:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186176 00000100:00100000:3.0:1783562464.511157:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186176 00000100:00100000:3.0:1783562464.511225:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562464.511236:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+6:13836:x1870200553186176:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783562464.511331:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+6:13836:x1870200553186176:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 97us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562464.511339:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562464.513713:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562464.513762:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.513862:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186304 00000100:00100000:2.0:1783562464.513873:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186304 00000100:00100000:2.0:1783562464.513921:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186432 00000100:00100000:2.0:1783562464.513924:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186432 00000100:00100000:2.0:1783562464.513945:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562464.513967:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553186304:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783562464.514000:0:14803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 56505833-5a6d-4dcf-a09f-d3837b93b675@192.168.204.4@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1783562464.514042:0:14803:0:(genops.c:1406:class_connect()) connect: client 56505833-5a6d-4dcf-a09f-d3837b93b675, cookie 0x4738ba0933b8920c 00002000:00100000:2.0:1783562464.514056:0:14803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 56505833-5a6d-4dcf-a09f-d3837b93b675/ffff9bfcd07c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783562464.514069:0:14803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783562464.514226:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562464.514238:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870200553186432:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783562464.514296:0:14806:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 56505833-5a6d-4dcf-a09f-d3837b93b675@192.168.204.4@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1783562464.514343:0:14806:0:(genops.c:1406:class_connect()) connect: client 56505833-5a6d-4dcf-a09f-d3837b93b675, cookie 0x4738ba0933b89213 00002000:00100000:0.0:1783562464.514366:0:14806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 56505833-5a6d-4dcf-a09f-d3837b93b675/ffff9bfce882e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562464.514379:0:14806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783562464.514492:0:14803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783562464.514538:0:14803:0:(import.c:65:import_set_state_nolock()) ffff9bfcd07c5800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1783562464.514541:0:14806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783562464.514586:0:14806:0:(import.c:65:import_set_state_nolock()) ffff9bfd00d41000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562464.514636:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2360:x1870200553186304:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 666us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562464.514659:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2360:x1870200553186432:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 411us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.514660:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562464.514681:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562464.515014:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.515104:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186560 00000100:00100000:2.0:1783562464.515111:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186560 00000100:00100000:2.0:1783562464.515156:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562464.515164:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:13836:x1870200553186560:12345-192.168.204.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783562464.515537:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783562464.515664:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:13836:x1870200553186560:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 500us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.515672:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:3.0:1783562464.606306:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562464.606441:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186688 00000100:00100000:2.0:1783562464.606457:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186688 00000100:00100000:2.0:1783562464.606529:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562464.606541:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:13866:x1870200553186688:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:2.0:1783562464.606565:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562464.606596:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b8921a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21644 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.606699:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.606718:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.606736:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562464.606975:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562464.606979:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562464.607064:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.607096:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b8921a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 8 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.607112:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 7 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562464.607121:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:2.0:1783562464.607124:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562464.607128:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1d400, rc 0) 00000100:00100000:2.0:1783562464.607201:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+7:13866:x1870200553186688:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 662us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562464.607209:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00010000:00010000:1.0:1783562465.336076:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562466.112295:0:16050:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783562466.361576:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562467.382774:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562468.003832:0:16198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb5d1b00 20000000:00000080:2.0:1783562468.003860:0:16198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfbc6a3c800 uarg=0000000000000000 20000000:01000000:2.0:1783562468.003911:0:16198:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783562468.003919:0:16198:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783562468.003926:0:16198:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783562468.004815:0:16199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1783562468.004926:0:16198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783562468.011633:0:16198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783562468.011681:0:16198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011706:0:16198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011715:0:16198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011724:0:16198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011735:0:16198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011743:0:16198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011751:0:16198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011811:0:16198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.011828:0:16198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.011863:0:16198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649280:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562468.012006:0:16198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.012015:0:16198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 12 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.012024:0:16198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649408:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562468.012059:0:16198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.012067:0:16198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 18 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.012077:0:16198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649536:0@lo:104: 00000100:00100000:2.0:1783562468.012140:0:16198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783562468.012178:0:16198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.012187:0:16198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.012195:0:16198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649664:0@lo:104: 00000100:00100000:3.0:1783562468.012213:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649536 00000100:00100000:2.0:1783562468.012219:0:16198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562468.012229:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649536 00010000:00010000:2.0:1783562468.012258:0:16198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.012267:0:16198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 18 pid: 14161 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.012298:0:16198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649792:0@lo:104: 00000100:00100000:3.0:1783562468.012308:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649664 00000100:00100000:3.0:1783562468.012312:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649664 00000100:00100000:2.0:1783562468.012330:0:16198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562468.012340:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562468.012345:0:16198:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562468.012354:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+4:16198:x1870200563649536:12345-0@lo:104: 00010000:00010000:3.0:1783562468.012373:0:14153:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012447:0:14153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783562468.012453:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+4:16198:x1870200563649536:12345-0@lo:104: Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562468.012459:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562468.012484:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783562468.012508:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649792 00000100:00100000:3.0:1783562468.012512:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649792 00000100:00100000:1.0:1783562468.012518:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783562468.012531:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+4:16198:x1870200563649664:12345-0@lo:104: 00010000:00010000:1.0:1783562468.012541:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012589:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783562468.012594:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+4:16198:x1870200563649664:12345-0@lo:104: Request processed in 69us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562468.012600:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783562468.012615:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783562468.012621:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783562468.012622:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc6953850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:16198:x1870200563649792:12345-0@lo:104: 00010000:00010000:3.0:1783562468.012630:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012640:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012642:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562468.012649:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012660:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012674:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783562468.012684:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc6953850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+3:16198:x1870200563649792:12345-0@lo:104: Request processed in 63us (354us total) trans 0 rc 0/0 10000000:00010000:3.0:1783562468.012685:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562468.012697:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:3.0:1783562468.012700:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783562468.012738:0:15964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012739:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562468.012747:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012749:0:15964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562468.012757:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562468.012762:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012770:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012777:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562468.012778:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562468.012795:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783562468.012796:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b890a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b890a7 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012812:0:14158:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012814:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562468.012818:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012824:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8000 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562468.012826:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012833:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562468.012839:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562468.012844:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783562468.012868:0:15964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012884:0:15964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562468.012884:0:14158:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562468.012898:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012907:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfceee1dc00/0x4738ba0933b88f5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f65 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012910:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.012930:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc5cb8000/0x4738ba0933b88f11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b88f18 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.012930:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562468.012934:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562468.012937:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562468.012946:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562468.012954:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562468.012958:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562468.012960:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562468.012977:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563649920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562468.012989:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563650048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562468.013013:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562468.013036:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563649920 00000100:00100000:1.0:1783562468.013041:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563649920 00010000:00010000:1.0:1783562468.013064:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 19 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562468.013088:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563650176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562468.013095:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562468.013103:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3274:x1870200563649920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562468.013113:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562468.013118:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 19 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.013128:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 19 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.013147:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562468.013247:0:16198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3800/0x4738ba0933b890a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b890a0 expref: 19 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562468.013258:0:16198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649536:0@lo:104: 00000100:00100000:2.0:1783562468.013267:0:16198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649664:0@lo:104: 00000100:00100000:2.0:1783562468.013273:0:16198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649792:0@lo:104: 00000100:00100000:2.0:1783562468.013308:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562468.013352:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:3274:x1870200563649920:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562468.013359:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562468.013375:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650048 00000100:00100000:1.0:1783562468.013378:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650048 00010000:00010000:1.0:1783562468.013391:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562468.013452:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783562468.013459:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:3275:x1870200563650048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562468.013467:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562468.013472:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.013481:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.013492:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8800/0x4738ba0933b88f65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88f5e expref: 18 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.013500:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562468.013523:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:3275:x1870200563650048:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562468.013529:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562468.013605:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563650048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562468.013696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562468.013735:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650176 00000100:00100000:3.0:1783562468.013742:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563649920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562468.013742:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650176 00010000:00010000:0.0:1783562468.013767:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 17 pid: 14161 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562468.013794:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783562468.013801:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:3272:x1870200563650176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562468.013810:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562468.013815:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 17 pid: 14161 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562468.013828:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 17 pid: 14161 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562468.013837:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6683200/0x4738ba0933b88f18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b88f11 expref: 17 pid: 14161 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562468.013846:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562468.013891:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3272:x1870200563650176:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562468.013894:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563650176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562468.013904:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562468.017017:0:16198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649280:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562468.017691:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562468.017760:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186816 00000100:00100000:2.0:1783562468.017770:0:16198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16198:1870200563649408:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562468.017783:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186816 00000100:00100000:1.0:1783562468.017806:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1783562468.017822:0:16198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562468.017844:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553186944 00000100:00100000:1.0:1783562468.017853:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553186944 00010000:00010000:1.0:1783562468.017892:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 13 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562468.017938:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562468.017950:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2364:x1870200553186944:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562468.017970:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562468.017978:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 13 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.018003:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 13 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.018025:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1c400/0x4738ba0933b89102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b8 expref: 13 pid: 14163 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562468.018044:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562468.018108:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:2364:x1870200553186944:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562468.018117:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00010000:00010000:3.0:1783562468.018178:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562468.018586:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562468.018599:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:2364:x1870200553186816:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562468.018614:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562468.018621:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018652:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018669:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b891fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2161a expref: 12 pid: 14164 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018683:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018690:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018709:0:14155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018713:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018719:0:14155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018724:0:14155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018729:0:14155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1de00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562468.018733:0:14155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018740:0:14155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018764:0:14155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562468.018775:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562468.018804:0:16198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.018818:0:16198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562468.018827:0:16198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1de00/0x4738ba0933b89228 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562468.018840:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:2364:x1870200553186816:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 242us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562468.018868:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:1.0:1783562468.407232:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562468.726549:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562468.726581:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563650304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562468.726672:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562468.726760:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650304 00000100:00100000:3.0:1783562468.726768:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650304 00000100:00100000:3.0:1783562468.726855:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783562468.726869:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563650304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562468.726914:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562468.726973:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563650304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562468.726983:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783562468.727014:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562468.727067:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563650304:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1783562468.758589:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000100:00100000:1.0:1783562469.119447:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562469.119600:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187072 00000100:00100000:2.0:1783562469.119613:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187072 00000100:00100000:2.0:1783562469.119685:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:2.0:1783562469.119698:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:13707:x1870200553187072:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562469.119720:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562469.119749:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b8922f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2164b expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.119791:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b8922f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2164b expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.119806:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b8922f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2164b expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.119817:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ca00, rc 0) 00000100:00100000:2.0:1783562469.120310:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187072:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 612us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.120320:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:1.0:1783562469.125280:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562469.125400:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187200 00000100:00100000:0.0:1783562469.125499:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187200 00000100:00100000:0.0:1783562469.125661:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:0.0:1783562469.125674:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187200:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562469.126250:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187200:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 577us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562469.126270:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:0.0:1783562469.130705:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562469.132020:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187328 00000100:00100000:2.0:1783562469.132042:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187328 00000100:00100000:2.0:1783562469.132136:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1783562469.132147:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187328:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.132455:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187328:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 309us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.132464:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1783562469.138118:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562469.138255:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187456 00000100:00100000:0.0:1783562469.138277:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187456 00000100:00100000:0.0:1783562469.138362:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:0.0:1783562469.138373:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:13707:x1870200553187456:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562469.138394:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562469.138463:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89236 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21652 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.138509:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21652 expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.138526:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89236 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21652 expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.138537:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e200, rc 0) 00000100:00100000:0.0:1783562469.138626:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13707:x1870200553187456:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 255us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562469.138635:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:1.0:1783562469.143529:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562469.143611:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187584 00000100:00100000:2.0:1783562469.143623:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187584 00000100:00100000:2.0:1783562469.143691:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:2.0:1783562469.143703:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13707:x1870200553187584:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.144116:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13707:x1870200553187584:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 413us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.144125:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:3.0:1783562469.150741:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562469.155134:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187712 00000100:00100000:2.0:1783562469.155157:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187712 00000100:00100000:2.0:1783562469.155246:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:2.0:1783562469.155259:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13707:x1870200553187712:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.155560:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:13707:x1870200553187712:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 304us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.155568:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:1.0:1783562469.238614:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563650432:0@lo:400:kworker.0 00000100:00100000:2.0:1783562469.238621:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563650816:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.238686:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563650688:0@lo:400:kworker.0 00000100:00100000:2.0:1783562469.238721:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.238721:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562469.238743:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563650560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562469.238789:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.238805:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563650944:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.238818:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563651200:0@lo:400:kworker.0 00000100:00100000:2.0:1783562469.238822:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650816 00000100:00100000:2.0:1783562469.238831:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650816 00000100:00100000:1.0:1783562469.238846:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562469.238877:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650560 00000100:00100000:3.0:1783562469.238884:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650560 00000100:00100000:2.0:1783562469.238913:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562469.238924:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563650816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.238938:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562469.238948:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563650560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562469.238998:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562469.239015:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563650816:12345-0@lo:400:kworker.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.239024:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562469.239058:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650432 00000100:00100000:2.0:1783562469.239063:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650432 00000100:00100000:2.0:1783562469.239103:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783562469.239116:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3274:x1870200563650432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239117:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563650560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.239129:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783562469.239157:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562469.239180:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650944 00000100:00100000:3.0:1783562469.239185:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650944 00000100:00100000:2.0:1783562469.239187:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:3274:x1870200563650432:12345-0@lo:400:kworker.0 Request processed in 76us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.239195:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783562469.239229:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783562469.239253:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563650944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239309:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563650944:12345-0@lo:400:kworker.0 Request processed in 60us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.239317:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562469.239340:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563650944:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239353:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.239362:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563650432:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239390:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563651072:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239466:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562469.239519:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563650688 00000100:00100000:3.0:1783562469.239525:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563650688 00000100:00100000:3.0:1783562469.239566:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562469.239575:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563650688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562469.239585:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:1.0:1783562469.239591:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcef1a8e00, transno 8589934593 00000100:00100000:1.0:1783562469.239609:0:3273:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfcef1aad80 x1870200563649152/t8589934594(8589934594) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783562480 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562469.239620:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563650816:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239623:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563650688:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.239633:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562469.239684:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.239738:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651072 00000100:00100000:1.0:1783562469.239744:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651072 00000100:00100000:2.0:1783562469.239763:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651200 00000100:00100000:2.0:1783562469.239769:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651200 00000100:00100000:1.0:1783562469.239786:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562469.239797:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563651072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562469.239814:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562469.239826:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563651200:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783562469.239840:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562469.239846:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563651072:12345-0@lo:400:kworker.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.239856:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562469.239880:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563651200:12345-0@lo:400:kworker.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.239884:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563650688:0@lo:400:kworker.0 00000100:00100000:2.0:1783562469.239894:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783562469.239906:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563651200:0@lo:400:kworker.0 00000100:00100000:3.0:1783562469.239907:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563651072:0@lo:400:kworker.0 00000100:00100000:1.0:1783562469.239954:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563650560:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783562469.240851:0:14193:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:2.0:1783562469.240985:0:14193:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1783562469.265318:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000001:00100000:0.0:1783562469.286650:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000001:00080000:0.0:1783562469.286676:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1783562469.430933:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783562469.494557:0:14166:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562469.494570:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfd00d46000 from 10 10000000:01000000:1.0:1783562469.494577:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562469.494651:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.494665:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.494679:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.494717:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.494826:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.494928:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562469.495036:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651328 00000100:00100000:2.0:1783562469.495045:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651328 00000100:00100000:2.0:1783562469.495112:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783562469.495122:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+16:14166:x1870200563651328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562469.495140:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562469.495157:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1c000/0x4738ba0933b89244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8923d expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.495187:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1c000/0x4738ba0933b89244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8923d expref: 17 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.495199:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1c000/0x4738ba0933b89244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8923d expref: 17 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.495229:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1c000, rc 0) 00000100:00100000:2.0:1783562469.495298:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.495307:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783562469.495660:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562469.495689:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.495698:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.495772:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.495804:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.495837:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562469.495904:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651456 00000100:00100000:2.0:1783562469.495910:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651456 00000100:00100000:2.0:1783562469.495940:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783562469.495949:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.496322:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.496330:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783562469.496481:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.496515:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.496556:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.496625:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562469.496671:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651584 00000100:00100000:2.0:1783562469.496675:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651584 00000100:00100000:2.0:1783562469.496710:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783562469.496718:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.496998:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.497005:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783562469.497066:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783562469.498176:0:16311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783562469.498988:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783562469.499024:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562469.499040:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.499057:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562469.499070:0:14166:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562469.499074:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6161000 from 10 10000000:01000000:1.0:1783562469.499077:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562469.499127:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.499160:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.499173:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.499203:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.499300:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.499396:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562469.501770:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651712 00000100:00100000:2.0:1783562469.501789:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651712 00000100:00100000:2.0:1783562469.501937:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783562469.501950:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:14166:x1870200563651712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562469.501974:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562469.502001:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b89252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8924b expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.502056:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b89252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8924b expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.502069:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b89252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8924b expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.502083:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1cc00, rc 0) 00000100:00100000:2.0:1783562469.502177:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563651712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562469.502185:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783562469.502309:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562469.502334:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.502346:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.502466:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.502507:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.502650:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562469.502696:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651840 00000100:00100000:0.0:1783562469.502702:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651840 00000100:00100000:0.0:1783562469.502727:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783562469.502734:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563651840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562469.503081:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563651840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562469.503088:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783562469.503232:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.503279:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.503319:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.503379:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd37870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562469.503618:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563651968 00000100:00100000:0.0:1783562469.503623:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563651968 00000100:00100000:0.0:1783562469.503658:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783562469.503666:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563651968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562469.503853:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563651968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562469.503861:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783562469.503943:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563651968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562469.505073:0:16312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783562469.505294:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783562469.505324:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783562469.505338:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.505353:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562469.505367:0:14166:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783562469.505370:0:14166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6881000 from 10 10000000:01000000:2.0:1783562469.505373:0:14166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783562469.505522:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.505531:0:14166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562469.505543:0:14166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562469.505584:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562469.505654:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562469.505745:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562469.505879:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563652096 00000100:00100000:0.0:1783562469.505887:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563652096 00000100:00100000:0.0:1783562469.505940:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783562469.505949:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:14166:x1870200563652096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562469.505965:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562469.505979:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89260 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89259 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.506006:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89259 expref: 19 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.506018:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89259 expref: 19 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562469.506028:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698ea00, rc 0) 00000100:00100000:0.0:1783562469.506084:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563652096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562469.506091:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783562469.506190:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562469.506205:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562469.506215:0:14166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.506287:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.506318:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.506343:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd3787240 going to sleep for 11 seconds 00000100:00100000:3.0:1783562469.506391:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563652224 00000100:00100000:3.0:1783562469.506396:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563652224 00000100:00100000:3.0:1783562469.506464:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783562469.506472:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563652224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562469.506757:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563652224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.506765:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783562469.506892:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.506922:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562469.506959:0:14166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562469.506990:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd3787240 going to sleep for 11 seconds 00000100:00100000:3.0:1783562469.507026:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563652352 00000100:00100000:3.0:1783562469.507030:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563652352 00000100:00100000:3.0:1783562469.507058:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783562469.507063:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563652352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562469.507215:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:14166:x1870200563652352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.507222:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783562469.507329:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e84b51d8-00f8-4fc5-9608-af3d9dda1905:14166:1870200563652352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562469.508310:0:16313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783562469.508571:0:14166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783562469.508595:0:14166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562469.508609:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562469.508621:0:14166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562469.821582:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821670:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821715:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821757:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821789:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821809:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821837:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562469.821870:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188352 00000100:00100000:1.0:1783562469.821894:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188352 00000100:00100000:1.0:1783562469.821972:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187968 00000100:00100000:1.0:1783562469.821994:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187968 00000100:00100000:1.0:1783562469.822022:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562469.822034:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2364:x1870200553188352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822132:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2364:x1870200553188352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 101us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822141:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562469.822163:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:1.0:1783562469.822169:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553187968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822191:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553187968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822197:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:1.0:1783562469.822215:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188096 00000100:00100000:1.0:1783562469.822219:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188096 00000100:00100000:1.0:1783562469.822240:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188608 00000100:00100000:1.0:1783562469.822243:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188608 00000100:00100000:1.0:1783562469.822271:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188224 00000100:00100000:1.0:1783562469.822275:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188224 00000100:00100000:1.0:1783562469.822287:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188480 00000100:00100000:1.0:1783562469.822289:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188480 00000100:00100000:1.0:1783562469.822305:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562469.822310:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553188096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822335:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553188096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822341:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562469.822353:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562469.822359:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553188608:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822394:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553188608:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822400:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:1.0:1783562469.822436:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562469.822443:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553188224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822466:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553188224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822471:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562469.822482:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562469.822488:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553188480:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562469.822507:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553188480:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 19us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562469.822512:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00080000:1.0:1783562469.822688:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783562469.822693:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783562469.822696:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562469.825854:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553187840 00000100:00100000:3.0:1783562469.825881:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553187840 00000100:00100000:3.0:1783562469.826047:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:3.0:1783562469.826062:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2364:x1870200553187840:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562469.826184:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2364:x1870200553187840:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 126us (4621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562469.826192:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:1.0:1783562470.049470:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.049818:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188736 00000100:00100000:2.0:1783562470.049828:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188736 00000100:00100000:2.0:1783562470.049889:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562470.049898:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:14375:x1870200553188736:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562470.049918:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.049941:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21659 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050015:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050030:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050045:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050060:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050079:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050087:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050883:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050898:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.050907:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.051000:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783562470.051005:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.051176:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051190:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051196:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051203:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051210:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.051215:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051223:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051238:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:2.0:1783562470.051257:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.051389:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051398:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b8926e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051443:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051450:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051456:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051461:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.051464:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051470:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051478:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562470.051481:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.051485:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051491:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b89275 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051537:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21659 expref: 8 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051566:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21659 expref: 7 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.051574:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc4c37700) 00010000:00010000:2.0:1783562470.051577:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562470.051579:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1de00, rc 0) 00000100:00100000:2.0:1783562470.051665:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:14375:x1870200553188736:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1767us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.051675:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562470.056483:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.056828:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553188992 00000100:00100000:2.0:1783562470.056841:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553188992 00000100:00100000:2.0:1783562470.056915:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1783562470.056928:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:14375:x1870200553188992:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562470.056955:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.056983:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b89283 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21660 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057189:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057206:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057220:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057267:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057291:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.057299:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058541:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89298 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058560:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89298 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058571:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89298 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.058582:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783562470.058910:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058919:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058927:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058933:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1dc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.058938:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058946:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058973:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc4c37700) 00010000:00010000:2.0:1783562470.058976:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.058981:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.058988:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b8928a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059002:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059009:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059015:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059020:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.059023:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059029:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059037:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.059039:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.059042:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059048:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b89291 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059715:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b89283 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21660 expref: 10 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059733:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89298 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21660 expref: 9 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.059741:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562470.059743:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.059746:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1da00, rc 0) 00000100:00100000:2.0:1783562470.059905:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14375:x1870200553188992:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 2978us (3438us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783562470.059914:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562470.064175:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.064319:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189120 00000100:00100000:2.0:1783562470.064334:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189120 00000100:00100000:2.0:1783562470.064435:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562470.064445:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14375:x1870200553189120:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783562470.064676:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14375:x1870200553189120:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 Request processed in 232us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.064682:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:1.0:1783562470.087945:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.088060:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189248 00000100:00100000:0.0:1783562470.088073:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189248 00000100:00100000:0.0:1783562470.088136:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:0.0:1783562470.088145:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14381:x1870200553189248:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562470.088182:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562470.088203:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b892a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21667 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088359:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088376:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088391:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088732:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088742:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.088749:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089037:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089044:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089051:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089057:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698fe00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.089069:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089077:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089089:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562470.089093:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.089098:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089104:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b892ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089118:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089124:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089129:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089134:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.089136:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089141:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089148:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bfcd860c600) 00010000:00010000:0.0:1783562470.089150:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.089159:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089165:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b892b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089203:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b892a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21667 expref: 10 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089216:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562470.089218:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.089221:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b892a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21667 expref: 10 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.089229:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e800, rc 0) 00000100:00100000:0.0:1783562470.089329:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14381:x1870200553189248:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1182us (1394us total) trans 0 rc 301/301 00000100:00100000:0.0:1783562470.089337:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562470.095216:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.095308:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189376 00000100:00100000:3.0:1783562470.095320:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189376 00000100:00100000:3.0:1783562470.095938:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562470.095947:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14381:x1870200553189376:12345-192.168.204.4@tcp:700:lfs.0 00000100:00100000:3.0:1783562470.096034:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14381:x1870200553189376:12345-192.168.204.4@tcp:700:lfs.0 Request processed in 87us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.096047:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562470.098101:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.098179:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189632 00000100:00100000:2.0:1783562470.098193:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189632 00000100:00100000:2.0:1783562470.098277:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562470.098290:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14381:x1870200553189632:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:2.0:1783562470.098351:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562470.098382:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89125 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e2 expref: 9 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.098460:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:2.0:1783562470.098466:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562470.098770:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.098786:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 5 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.098796:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.098837:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 5 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.098853:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 5 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.098871:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563652480:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.098991:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562470.100843:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563652480:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562470.100887:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.101607:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.101661:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189760 00000100:00100000:2.0:1783562470.101669:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189760 00010000:00010000:2.0:1783562470.101704:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 6 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.101754:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:2.0:1783562470.101775:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2364:x1870200553189760:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562470.101790:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562470.101796:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 6 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101808:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 6 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101830:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b89221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21644 expref: 6 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101845:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:2.0:1783562470.101850:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101859:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101866:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.101890:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562470.101940:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553189760:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 177us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.101947:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00010000:00010000:1.0:1783562470.101989:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.102010:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.102049:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.102060:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.102070:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562470.103569:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783562470.103585:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103595:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103602:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103608:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562470.103613:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103622:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103636:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:1.0:1783562470.103640:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562470.103652:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.103658:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562470.103681:0:14170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e19d634 reply state 000000006d30067a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.103691:0:14170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783562470.103797:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+10:14381:x1870200553189632:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 5506us (5705us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783562470.103805:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00010000:00010000:0.0:1783562470.104904:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104922:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104929:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104934:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.104939:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104961:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104976:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bfcc9774000) 00010000:00010000:0.0:1783562470.104979:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.104982:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.104987:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b892c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.148287:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.148621:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553189888 00000100:00100000:2.0:1783562470.148642:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553189888 00000100:00100000:2.0:1783562470.148704:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562470.148713:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14389:x1870200553189888:12345-192.168.204.4@tcp:101:lctl.0 00010000:00010000:2.0:1783562470.148734:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.148752:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b892c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2166e expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148818:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148830:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148839:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.148901:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562470.148904:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.148934:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148952:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b892c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2166e expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148966:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2166e expref: 10 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.148973:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.148975:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562470.148978:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1ce00, rc 0) 00000100:00100000:2.0:1783562470.149046:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+10:14389:x1870200553189888:12345-192.168.204.4@tcp:101:lctl.0 Request processed in 333us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.149059:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:1.0:1783562470.164440:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.164562:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553190016 00000100:00100000:2.0:1783562470.164577:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553190016 00000100:00100000:2.0:1783562470.164699:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1783562470.164712:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+5:14390:x1870200553190016:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.164738:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.164779:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b892d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21675 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.164876:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.164892:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.164906:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.164979:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783562470.164983:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.165010:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.165050:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d400/0x4738ba0933b892d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21675 expref: 7 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.165071:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21675 expref: 6 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.165102:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.165105:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562470.165109:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfceee1dc00, rc 0) 00000100:00100000:2.0:1783562470.165178:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+6:14390:x1870200553190016:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 469us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.165186:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:3.0:1783562470.167666:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.167715:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553190144 00000100:00100000:2.0:1783562470.167725:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553190144 00000100:00100000:2.0:1783562470.167851:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:2.0:1783562470.167862:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:14390:x1870200553190144:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.167883:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.167902:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b892e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2167c expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.167960:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.167973:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.167984:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.167999:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168006:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168029:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168178:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168186:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168193:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.168233:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783562470.168237:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.168279:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168292:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168299:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168304:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168310:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.168315:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168322:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168342:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.168344:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.168349:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168355:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1d200/0x4738ba0933b892ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168369:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168375:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168380:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168385:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.168389:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168394:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168427:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562470.168430:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.168433:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168438:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c400/0x4738ba0933b892f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168478:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1c600/0x4738ba0933b892e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2167c expref: 8 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168490:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2167c expref: 7 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.168497:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562470.168499:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562470.168501:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336000, rc 0) 00000100:00100000:2.0:1783562470.168570:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+7:14390:x1870200553190144:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 709us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.168577:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:3.0:1783562470.171564:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562470.171745:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553190400 00000100:00100000:1.0:1783562470.171760:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553190400 00000100:00100000:1.0:1783562470.171856:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:1.0:1783562470.171873:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+7:14390:x1870200553190400:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562470.171902:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562470.171933:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89301 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21683 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562470.172097:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783562470.172275:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89301 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21683 expref: 9 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.172294:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:1.0:1783562470.172299:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562470.172325:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21683 expref: 9 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.172371:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683e00, rc 0) 00000100:00100000:1.0:1783562470.172506:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+8:14390:x1870200553190400:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 637us (1014us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783562470.172516:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:1.0:1783562470.175208:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.175670:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553190656 00000100:00100000:0.0:1783562470.175681:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553190656 00000100:00100000:0.0:1783562470.175784:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:0.0:1783562470.175796:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+8:14390:x1870200553190656:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:0.0:1783562470.175861:0:15489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562470.175892:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b892fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2167c expref: 8 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.175917:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562470.175932:0:15489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562470.175959:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.175973:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.175982:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562470.176286:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2e5f895 reply state 00000000b032822b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.176296:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783562470.176313:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1783562470.176445:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+9:14390:x1870200553190656:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 650us (1249us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783562470.176454:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:3.0:1783562470.179437:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.179702:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553190912 00000100:00100000:0.0:1783562470.179713:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553190912 00000100:00100000:0.0:1783562470.179780:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:0.0:1783562470.179789:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+9:14390:x1870200553190912:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562470.180066:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+10:14390:x1870200553190912:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 277us (669us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783562470.180074:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00010000:00010000:2.0:1783562470.180221:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180232:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180239:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180257:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.180262:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180270:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180292:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcd860c600) 00010000:00010000:2.0:1783562470.180309:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783562470.180315:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.180321:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8930f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.183461:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.183720:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553191168 00000100:00100000:2.0:1783562470.183732:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553191168 00000100:00100000:2.0:1783562470.183797:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:2.0:1783562470.183809:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+9:14390:x1870200553191168:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.183832:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.183853:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2168a expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183930:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183945:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183957:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183969:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183976:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.183982:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.184131:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783562470.184234:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184252:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184259:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184265:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.184270:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184278:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184290:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.184293:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.184297:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184304:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8931d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184317:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184323:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184338:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184344:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.184346:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184352:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184359:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bfcc4c37200) 00010000:00010000:2.0:1783562470.184362:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.184364:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184370:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89324 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184437:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89316 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2168a expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184446:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.184448:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562470.184452:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2168a expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.184462:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:2.0:1783562470.184530:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+10:14390:x1870200553191168:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 724us (1079us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783562470.184545:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:1.0:1783562470.188901:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.189365:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553191296 00000100:00100000:2.0:1783562470.189376:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553191296 00000100:00100000:2.0:1783562470.189462:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562470.189474:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+10:14390:x1870200553191296:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.189511:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.189541:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b89332 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21691 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.189646:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.189660:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.189822:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.189880:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783562470.189884:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.190270:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.190307:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b89332 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 12 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.190327:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.190358:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562470.190361:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562470.190366:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336c00, rc 0) 00000100:00100000:2.0:1783562470.190663:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+11:14390:x1870200553191296:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1190us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.190676:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:3.0:1783562470.194256:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.194337:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553191424 00000100:00100000:0.0:1783562470.194348:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553191424 00000100:00100000:0.0:1783562470.194438:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:0.0:1783562470.194451:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+11:14390:x1870200553191424:12345-192.168.204.4@tcp:37:lfs.0 00000100:00100000:3.0:1783562470.194452:0:14172:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1783562470.194464:0:14172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1783562470.200523:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+11:14390:x1870200553191424:12345-192.168.204.4@tcp:37:lfs.0 Request processed in 6065us (6281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562470.200536:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:1.0:1783562470.203149:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.203286:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553191680 00000100:00100000:2.0:1783562470.203295:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553191680 00000100:00100000:2.0:1783562470.203337:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:2.0:1783562470.203346:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+11:14390:x1870200553191680:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562470.203624:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+12:14390:x1870200553191680:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 280us (482us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783562470.203631:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562470.232163:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562470.232253:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553191808 00000100:00100000:1.0:1783562470.232265:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553191808 00000100:00100000:1.0:1783562470.232346:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562470.232358:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+10:14396:x1870200553191808:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562470.232380:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562470.232446:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21698 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232520:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232546:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232560:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232576:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232584:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.232605:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234089:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234107:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234119:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562470.234165:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783562470.234169:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562470.234214:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234227:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234234:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234253:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234260:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562470.234264:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234272:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234294:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:1.0:1783562470.234296:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562470.234300:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234304:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234315:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234318:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234321:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234325:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562470.234327:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234330:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234333:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bfcc9774f00) 00010000:00010000:1.0:1783562470.234335:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562470.234336:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234339:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8934e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234378:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21698 expref: 12 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234391:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21698 expref: 11 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.234399:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562470.234445:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783562470.234448:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682a00, rc 0) 00000100:00100000:1.0:1783562470.234519:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+11:14396:x1870200553191808:12345-192.168.204.4@tcp:101:bash.0 Request processed in 2163us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562470.234528:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:3.0:1783562470.238773:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.238831:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553192064 00000100:00100000:0.0:1783562470.238842:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553192064 00000100:00100000:0.0:1783562470.238911:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562470.238921:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+11:14396:x1870200553192064:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562470.238958:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562470.238980:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8935c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2169f expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.239118:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.239134:0:15489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.239144:0:15489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.239176:0:15489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.239607:0:15489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 11 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.239635:0:15489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563652608:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562470.239750:0:15489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562470.243015:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.243159:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553192192 00000100:00100000:3.0:1783562470.243172:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553192192 00010000:00010000:3.0:1783562470.243233:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 12 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.243300:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562470.243330:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+12:2364:x1870200553192192:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562470.243346:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562470.243354:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 12 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.243370:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 12 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.243435:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562470.243442:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.243455:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.243465:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.243490:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562470.243572:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+12:2364:x1870200553192192:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 243us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.243582:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00010000:00010000:0.0:1783562470.243620:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b89339 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21691 expref: 11 pid: 14171 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.243643:0:15489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563652608:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562470.243667:0:15489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.243688:0:15489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.243694:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.243719:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.243729:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.243737:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245207:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245225:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245236:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562470.245260:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783562470.245293:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245301:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245309:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245323:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698fe00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.245328:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245336:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245349:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562470.245352:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.245356:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245362:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b89363 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562470.245377:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000faf40126 reply state 00000000c720a0f6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.245386:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783562470.245461:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8935c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 14 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245477:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 13 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.245484:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562470.245488:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1783562470.245490:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f600, rc 0) 00000100:00100000:0.0:1783562470.245582:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14396:x1870200553192064:12345-192.168.204.4@tcp:101:bash.0 Request processed in 6662us (6829us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783562470.245598:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00010000:00010000:0.0:1783562470.248297:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248319:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248328:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248334:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.248339:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248348:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248369:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd860cd00) 00010000:00010000:0.0:1783562470.248372:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.248377:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.248384:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8936a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.257024:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.257091:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553192320 00000100:00100000:2.0:1783562470.257102:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553192320 00000100:00100000:2.0:1783562470.257167:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:2.0:1783562470.257179:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:14396:x1870200553192320:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562470.257202:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.257227:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8937f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216a6 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257321:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257337:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257366:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.257450:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783562470.257455:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562470.257478:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257489:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257520:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8937f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 15 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257540:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 14 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.257549:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.257553:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562470.257557:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336e00, rc 0) 00000100:00100000:2.0:1783562470.257702:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14396:x1870200553192320:12345-192.168.204.4@tcp:101:bash.0 Request processed in 526us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.257709:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:2.0:1783562470.260517:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.260602:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553192576 00000100:00100000:0.0:1783562470.260616:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553192576 00000100:00100000:0.0:1783562470.260702:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562470.260713:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14396:x1870200553192576:12345-192.168.204.4@tcp:35:bash.0 00000001:00080000:0.0:1783562470.261082:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:0.0:1783562470.261283:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:14396:x1870200553192576:12345-192.168.204.4@tcp:35:bash.0 Request processed in 570us (783us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1783562470.261293:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000020:00080000:0.0:1783562470.261297:0:14173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783562470.310274:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.310507:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553192832 00000100:00100000:2.0:1783562470.310519:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553192832 00000100:00100000:2.0:1783562470.310591:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562470.310603:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:14406:x1870200553192832:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.310648:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.310670:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8938d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216ad expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.310929:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783562470.311074:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8938d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216ad expref: 18 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.311091:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:2.0:1783562470.311095:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562470.311100:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8938d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216ad expref: 18 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.311117:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:2.0:1783562470.311247:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+17:14406:x1870200553192832:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 638us (973us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1783562470.311256:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:1.0:1783562470.315107:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.315216:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193088 00000100:00100000:2.0:1783562470.315226:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193088 00000100:00100000:2.0:1783562470.315341:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562470.315352:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+17:14406:x1870200553193088:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562470.315686:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14406:x1870200553193088:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 334us (586us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783562470.315695:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562470.344450:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.344579:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193344 00000100:00100000:2.0:1783562470.344590:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193344 00000100:00100000:2.0:1783562470.344745:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:2.0:1783562470.344774:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14409:x1870200553193344:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562470.344797:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.345152:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8939b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216b4 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.346015:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b893a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.346033:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b893a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.346046:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b893a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562470.346059:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783562470.346196:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8939b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216b4 expref: 21 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.346216:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b893a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216b4 expref: 20 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.346226:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.346229:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783562470.346233:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337800, rc 0) 00000100:00100000:2.0:1783562470.346378:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14409:x1870200553193344:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1604us (1938us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783562470.346387:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:0.0:1783562470.351130:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.351237:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193472 00000100:00100000:3.0:1783562470.351259:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193472 00000100:00100000:3.0:1783562470.351333:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562470.351344:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14409:x1870200553193472:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562470.351566:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351602:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351616:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351647:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351654:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351675:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351682:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562470.351687:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351695:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351708:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.351715:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562470.351720:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.351727:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.352082:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14409:x1870200553193472:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 738us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.352098:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00010000:00010000:3.0:1783562470.454612:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562470.531850:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.532094:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193728 00000100:00100000:2.0:1783562470.532109:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193728 00000100:00100000:2.0:1783562470.532189:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:2.0:1783562470.532201:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14446:x1870200553193728:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1783562470.532308:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.532340:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216bb expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532510:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532527:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 21 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532537:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532548:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532594:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532610:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 21 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.532625:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563652736:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562470.532762:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 21 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.532785:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 21 pid: 15489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.532795:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563652864:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.532828:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562470.539945:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563652736:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.539957:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.539965:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563652864:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.539992:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.540024:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193984 00000100:00100000:2.0:1783562470.540033:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193984 00010000:00010000:2.0:1783562470.540079:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 22 pid: 15489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.540110:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553193856 00000100:00100000:2.0:1783562470.540114:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553193856 00010000:00010000:2.0:1783562470.540127:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 23 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.540155:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562470.540166:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:2364:x1870200553193984:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562470.540186:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562470.540209:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 23 pid: 15489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.540221:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 23 pid: 15489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.540278:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89371 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2169f expref: 23 pid: 15489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.540352:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562470.540363:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:2364:x1870200553193856:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562470.540854:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562470.540863:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 22 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.541263:0:14169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.541302:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.541310:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.541319:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.541325:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562470.541386:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:2364:x1870200553193984:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1221us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.541395:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00010000:00010000:0.0:1783562470.541688:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 22 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.541708:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89386 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216a6 expref: 22 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.541723:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562470.541727:0:14832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.541734:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.541741:0:14832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.541836:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562470.541858:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:2364:x1870200553193856:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1498us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562470.541878:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00010000:00010000:3.0:1783562470.542467:0:14169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.542480:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.542502:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783562470.542708:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 22 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.542732:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.542741:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.542744:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783562470.542748:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:3.0:1783562470.542806:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14446:x1870200553193728:12345-192.168.204.4@tcp:101:dd.0 Request processed in 10606us (10969us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783562470.542816:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:1.0:1783562470.549471:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.549569:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553194240 00000100:00100000:2.0:1783562470.549588:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553194240 00000100:00100000:2.0:1783562470.549650:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:2.0:1783562470.549661:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14446:x1870200553194240:12345-192.168.204.4@tcp:36:dd.0 00010000:00010000:2.0:1783562470.549948:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.549966:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.549977:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562470.550632:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934607 00000004:00010000:2.0:1783562470.550679:0:14171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ea51730 reply state 000000009a84b6a7 transno 8589934608 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.550689:0:14171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562470.550807:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14446:x1870200553194240:12345-192.168.204.4@tcp:36:dd.0 Request processed in 1146us (1345us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783562470.550822:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000020:00080000:2.0:1783562470.550827:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783562470.552734:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552753:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552762:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552768:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.552774:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552781:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552799:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.552802:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.552807:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.552825:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562470.648208:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783562470.648219:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562470.648703:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783562470.648785:0:14203:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562470.648824:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1783562470.690919:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.691191:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553194368 00000100:00100000:2.0:1783562470.691229:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553194368 00000100:00100000:2.0:1783562470.691338:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:2.0:1783562470.691356:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:14460:x1870200553194368:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:2.0:1783562470.691391:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.691464:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216c2 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691551:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691567:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691580:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691597:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691605:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691612:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691724:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691736:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 23 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691744:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691797:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 23 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.691813:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 23 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.691828:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563652992:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.691968:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783562470.697647:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563652992:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562470.697653:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1783562470.697680:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.698317:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553194624 00000100:00100000:1.0:1783562470.698328:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553194624 00000100:00100000:1.0:1783562470.698392:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562470.698435:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:13704:x1870200553194624:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783562470.698728:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+25:13704:x1870200553194624:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 325us (1093us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1783562470.698736:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562470.703921:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.704560:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553194752 00000100:00100000:2.0:1783562470.704572:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553194752 00010000:00010000:2.0:1783562470.704616:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 25 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.704662:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:2.0:1783562470.704673:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+25:2363:x1870200553194752:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562470.704689:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562470.704696:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 25 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704710:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 25 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704753:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b893be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216bb expref: 25 pid: 14169 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704770:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.704775:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704785:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704793:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.704831:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562470.704890:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:2363:x1870200553194752:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 219us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562470.704898:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00010000:00010000:3.0:1783562470.706363:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706384:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.706459:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783562470.706464:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562470.706508:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706520:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706528:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706533:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706537:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706541:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562470.706544:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706548:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706558:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562470.706560:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562470.706562:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706573:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b893da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706583:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706586:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706590:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706593:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562470.706595:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706598:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706602:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc4c37200) 00010000:00010000:3.0:1783562470.706603:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562470.706605:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706608:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b893e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706643:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b893d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c2 expref: 24 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706668:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c2 expref: 23 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.706675:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.706678:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562470.706680:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336e00, rc 0) 00000100:00100000:3.0:1783562470.706741:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14460:x1870200553194368:12345-192.168.204.4@tcp:101:stat.0 Request processed in 15392us (15835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.706750:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:1.0:1783562470.744638:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.744741:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553195008 00000100:00100000:3.0:1783562470.744756:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553195008 00000100:00100000:3.0:1783562470.744828:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:3.0:1783562470.744839:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14466:x1870200553195008:12345-192.168.204.4@tcp:36:truncate.0 00010000:00010000:3.0:1783562470.744916:0:15489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562470.744952:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b893e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c2 expref: 23 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.744975:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.744979:0:15489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562470.745250:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.745267:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.745279:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783562470.745350:0:15489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:3.0:1783562470.745374:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000405349a5 reply state 000000007b847858 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.745385:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783562470.745584:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+25:14466:x1870200553195008:12345-192.168.204.4@tcp:36:truncate.0 Request processed in 747us (964us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1783562470.745592:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00000020:00080000:3.0:1783562470.745598:0:15489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783562470.747660:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747680:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747688:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747695:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562470.747701:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747709:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747727:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562470.747730:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562470.747735:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.747742:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.840328:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.840639:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553195136 00000100:00100000:3.0:1783562470.840651:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553195136 00000100:00100000:3.0:1783562470.840832:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:3.0:1783562470.840841:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:14480:x1870200553195136:12345-192.168.204.4@tcp:101:stat.0 00010000:00010000:3.0:1783562470.840861:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562470.840881:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b893f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216c9 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.840952:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.840970:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.840980:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.840993:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841019:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841026:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841146:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841155:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841162:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.841210:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1783562470.841215:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562470.841247:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841259:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841267:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841275:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841282:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841299:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562470.841305:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841313:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841327:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562470.841330:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562470.841335:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841340:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b893fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841356:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841362:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841368:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841373:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562470.841376:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841382:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841399:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd19d2000) 00010000:00010000:3.0:1783562470.841448:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562470.841452:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841459:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89404 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841497:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b893f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 26 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841510:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 25 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.841517:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.841520:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562470.841522:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:3.0:1783562470.841603:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+25:14480:x1870200553195136:12345-192.168.204.4@tcp:101:stat.0 Request processed in 763us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.841610:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:2.0:1783562470.879201:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.879388:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553195392 00000100:00100000:3.0:1783562470.879398:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553195392 00000100:00100000:3.0:1783562470.879531:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:3.0:1783562470.879541:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+25:14490:x1870200553195392:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562470.879561:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562470.879581:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216d0 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.879736:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783562470.879867:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89412 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d0 expref: 27 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.879881:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:3.0:1783562470.879884:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562470.879889:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d0 expref: 27 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.879904:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562470.879969:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14490:x1870200553195392:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 428us (777us total) trans 8589934612 rc 301/301 00000100:00100000:3.0:1783562470.879976:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:1.0:1783562470.882812:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.882944:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553195648 00000100:00100000:2.0:1783562470.882958:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553195648 00000100:00100000:3.0:1783562470.883215:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562470.883226:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14490:x1870200553195648:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:3.0:1783562470.883544:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:14490:x1870200553195648:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 319us (746us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1783562470.883552:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:1.0:1783562470.930156:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562470.930347:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553195904 00000100:00100000:2.0:1783562470.930367:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553195904 00000100:00100000:2.0:1783562470.930568:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:2.0:1783562470.930583:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:14496:x1870200553195904:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562470.930621:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562470.930644:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b89420 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216d7 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.930802:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.930821:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 28 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.930830:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.930871:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 28 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.930885:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 28 pid: 14169 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.930899:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563653120:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562470.931021:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e780 going to sleep for 11 seconds 00000100:00100000:2.0:1783562470.936263:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.936381:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553196032 00000100:00100000:0.0:1783562470.936393:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553196032 00010000:00010000:0.0:1783562470.936485:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 29 pid: 14169 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.936547:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:0.0:1783562470.936558:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:2364:x1870200553196032:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562470.936574:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562470.936581:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 29 pid: 14169 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.936601:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 29 pid: 14169 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.936627:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562470.936633:0:14832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.936644:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.936652:0:14832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.936673:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562470.936745:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:2364:x1870200553196032:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 187us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562470.936754:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00010000:00010000:3.0:1783562470.937169:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8940b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216c9 expref: 28 pid: 14169 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.937194:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563653120:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562470.937221:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.937266:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.937273:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.937293:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1783562470.937561:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b89420 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 29 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.937578:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 28 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.937585:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.937589:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783562470.937591:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:3.0:1783562470.937631:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+28:14496:x1870200553195904:12345-192.168.204.4@tcp:101:bash.0 Request processed in 7052us (7490us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1783562470.937639:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:2.0:1783562470.942972:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562470.943153:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553196288 00000100:00100000:0.0:1783562470.943168:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553196288 00000100:00100000:0.0:1783562470.943261:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:0.0:1783562470.943275:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+28:14496:x1870200553196288:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:0.0:1783562470.943777:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.943800:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562470.943816:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562470.943875:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934615 00000004:00010000:0.0:1783562470.943906:0:14171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006de87c7b reply state 0000000021d401a0 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562470.943919:0:14171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562470.944098:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14496:x1870200553196288:12345-192.168.204.4@tcp:36:bash.0 Request processed in 825us (1140us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1783562470.944168:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 40 00000020:00080000:0.0:1783562470.944175:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783562470.946987:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947016:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947025:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947032:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562470.947058:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947068:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947091:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:2.0:1783562470.947095:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562470.947100:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562470.947119:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f600/0x4738ba0933b89435 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.950504:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562470.950892:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553196416 00000100:00100000:3.0:1783562470.950903:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553196416 00000100:00100000:3.0:1783562470.950973:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:3.0:1783562470.950994:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+30:14496:x1870200553196416:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562470.951023:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562470.951049:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8943c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216de expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.951162:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.951177:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 31 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.951186:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.951955:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 31 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.951970:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 31 pid: 14170 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562470.952047:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563653248:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562470.952159:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc52a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562470.956392:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563653248:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562470.956481:0:14169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562470.956754:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562470.957073:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553196544 00000100:00100000:1.0:1783562470.957081:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553196544 00010000:00010000:1.0:1783562470.957128:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 32 pid: 14170 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562470.957171:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562470.957182:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:2364:x1870200553196544:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562470.957202:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562470.957211:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 32 pid: 14170 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957225:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 32 pid: 14170 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957274:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89427 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216d7 expref: 32 pid: 14170 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957293:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:1.0:1783562470.957298:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957309:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957335:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562470.957356:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562470.957465:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:2364:x1870200553196544:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 283us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562470.957475:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00010000:00010000:3.0:1783562470.957569:0:14169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.957576:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562470.957632:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783562470.957644:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562470.957671:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.957706:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8943c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216de expref: 31 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.957721:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216de expref: 30 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562470.957728:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562470.957730:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562470.957733:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562470.957774:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+30:14496:x1870200553196416:12345-192.168.204.4@tcp:101:bash.0 Request processed in 6792us (7281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562470.957783:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:2.0:1783562470.962831:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562470.962889:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553196800 00000100:00100000:1.0:1783562470.962900:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553196800 00000100:00100000:1.0:1783562470.962958:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562470.962969:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+30:14496:x1870200553196800:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:1.0:1783562470.963262:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14496:x1870200553196800:12345-192.168.204.4@tcp:35:bash.0 Request processed in 295us (443us total) trans 8589934617 rc 0/0 00000100:00100000:1.0:1783562470.963272:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562471.011946:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.012011:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553197056 00000100:00100000:3.0:1783562471.012022:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553197056 00000100:00100000:3.0:1783562471.012093:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:3.0:1783562471.012106:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14506:x1870200553197056:12345-192.168.204.4@tcp:101:lfs.0 00000100:00080000:1.0:1783562471.012107:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783562471.012133:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562471.012153:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8944a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216e5 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562471.012399:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783562471.012583:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8944a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216e5 expref: 33 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.012600:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:3.0:1783562471.012617:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562471.012624:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8944a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216e5 expref: 33 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.012642:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:3.0:1783562471.012969:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14506:x1870200553197056:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 865us (1041us total) trans 8589934618 rc 301/301 00000100:00100000:3.0:1783562471.012979:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:2.0:1783562471.016776:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.018765:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553197184 00000100:00100000:3.0:1783562471.018787:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553197184 00000100:00100000:3.0:1783562471.018893:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:3.0:1783562471.018905:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14506:x1870200553197184:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:3.0:1783562471.019003:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019025:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019040:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019060:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019068:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019075:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019453:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019581:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019589:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783562471.019646:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019659:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019667:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019674:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019681:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.019687:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019696:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019711:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562471.019714:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.019720:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019727:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89458 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019752:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019759:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019765:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019770:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.019773:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019779:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019788:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd19d2000) 00010000:00010000:3.0:1783562471.019790:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.019793:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019800:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b8945f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019819:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019827:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019832:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019847:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.019851:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019857:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019866:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562471.019868:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.019871:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.019877:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89466 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.021711:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14506:x1870200553197184:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 2788us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.021810:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:2.0:1783562471.028871:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.028948:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553197440 00000100:00100000:3.0:1783562471.028970:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553197440 00000100:00100000:3.0:1783562471.029102:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562471.029116:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14506:x1870200553197440:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562471.029962:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+33:14506:x1870200553197440:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 845us (1103us total) trans 8589934619 rc 0/0 00000100:00100000:2.0:1783562471.029974:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562471.059085:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.059208:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553197696 00000100:00100000:0.0:1783562471.059219:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553197696 00000100:00100000:0.0:1783562471.059300:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:0.0:1783562471.059311:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+33:14509:x1870200553197696:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562471.059336:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562471.059358:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8946d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216ec expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059496:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059511:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059523:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059538:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059545:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059552:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059685:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89482 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059694:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059702:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562471.059712:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783562471.059810:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059827:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059834:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059841:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562471.059845:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059853:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059865:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562471.059868:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562471.059873:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059879:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89474 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059892:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059899:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059904:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059910:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562471.059917:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059923:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059931:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd860cd00) 00010000:00010000:0.0:1783562471.059933:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562471.059936:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059941:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b8947b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059981:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8946d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216ec expref: 36 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.059994:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89482 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216ec expref: 35 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.060001:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562471.060004:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562471.060006:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e800, rc 0) 00000100:00100000:0.0:1783562471.060081:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14509:x1870200553197696:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 771us (1007us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783562471.060088:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:1.0:1783562471.062971:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.063015:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.063107:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198080 00000100:00100000:2.0:1783562471.063118:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198080 00000100:00100000:2.0:1783562471.063176:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562471.063187:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14509:x1870200553198080:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562471.063457:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14509:x1870200553198080:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 271us (440us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1783562471.063464:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562471.063939:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553197824 00000100:00100000:0.0:1783562471.063945:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553197824 00000100:00100000:0.0:1783562471.063989:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:0.0:1783562471.063997:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:2364:x1870200553197824:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562471.064016:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562471.064041:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89482 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216ec expref: 36 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.064060:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:0.0:1783562471.064065:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562471.064141:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:2364:x1870200553197824:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 144us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562471.064148:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562471.065807:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.065931:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198208 00000100:00100000:3.0:1783562471.065940:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198208 00000100:00100000:3.0:1783562471.065994:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:3.0:1783562471.066003:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14509:x1870200553198208:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562471.066064:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066099:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066111:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066140:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066148:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066154:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066160:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.066165:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066173:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066184:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:3.0:1783562471.066187:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562471.066191:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.066197:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89490 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.066282:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14509:x1870200553198208:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 280us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.066295:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:1.0:1783562471.179015:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.179097:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198336 00000100:00100000:0.0:1783562471.179108:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198336 00000100:00100000:0.0:1783562471.179167:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:0.0:1783562471.179176:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14528:x1870200553198336:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562471.179201:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562471.179234:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216f3 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179312:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179329:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179342:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562471.179455:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783562471.179459:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562471.179502:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179529:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b89497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216f3 expref: 37 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179548:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216f3 expref: 36 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.179557:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562471.179560:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562471.179564:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698fe00, rc 0) 00000100:00100000:0.0:1783562471.179626:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14528:x1870200553198336:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 451us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562471.179634:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:1.0:1783562471.183125:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.183248:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198720 00000100:00100000:2.0:1783562471.183261:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198720 00000100:00100000:2.0:1783562471.183371:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:2.0:1783562471.183382:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14528:x1870200553198720:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:3.0:1783562471.184055:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14528:x1870200553198720:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 671us (937us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1783562471.184065:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:2.0:1783562471.187182:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.187328:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198848 00000100:00100000:1.0:1783562471.187350:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198848 00000100:00100000:1.0:1783562471.187460:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:1.0:1783562471.187473:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14528:x1870200553198848:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:1.0:1783562471.187511:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783562471.187542:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b89443 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216de expref: 37 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.187583:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b893a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216b4 expref: 36 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.187595:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd860c000) 00010000:00010000:1.0:1783562471.187608:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562471.187689:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14528:x1870200553198848:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 218us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562471.187697:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562471.189737:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.189996:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553198976 00000100:00100000:3.0:1783562471.190008:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553198976 00000100:00100000:3.0:1783562471.190084:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1783562471.190096:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14528:x1870200553198976:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:3.0:1783562471.190238:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.190255:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.190268:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562471.190799:0:14169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562471.190865:0:14169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1783562471.190944:0:14169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1783562471.191071:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14528:x1870200553198976:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 976us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.191080:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:0.0:1783562471.204720:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.204775:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199104 00000100:00100000:3.0:1783562471.204787:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199104 00000100:00100000:3.0:1783562471.204849:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:3.0:1783562471.204862:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14530:x1870200553199104:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562471.204885:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562471.204920:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b894ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c216fa expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.204991:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205006:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205017:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205031:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205038:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205044:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205151:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205159:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205166:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562471.205207:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783562471.205212:0:15489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562471.205247:0:15489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205267:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205276:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205283:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205291:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205298:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.205303:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205311:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205325:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562471.205328:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.205334:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205341:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b894b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205353:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205358:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205383:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205389:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.205392:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205399:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205453:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd19d2100) 00010000:00010000:3.0:1783562471.205456:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.205459:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205466:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205503:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b894ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 37 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205516:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 36 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.205523:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:3.0:1783562471.205525:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562471.205528:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c9600, rc 0) 00000100:00100000:3.0:1783562471.205606:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14530:x1870200553199104:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 748us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.205621:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00010000:00010000:0.0:1783562471.479619:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783562471.659581:0:16353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783562471.659591:0:16353:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562471.659629:0:16353:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783562471.660090:0:16353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1783562471.671862:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562471.671875:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562471.671933:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783562471.671940:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783562471.672101:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563653376:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562471.672236:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562471.677336:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.678178:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563653376:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783562471.679092:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199232 00000100:00100000:1.0:1783562471.679103:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199232 00000100:00100000:1.0:1783562471.679164:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562471.679176:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199232:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783562471.679299:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199232:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 Request processed in 124us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562471.679309:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562471.682061:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.682176:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199360 00000100:00100000:2.0:1783562471.682190:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199360 00000100:00100000:2.0:1783562471.682301:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:2.0:1783562471.682312:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199360:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562471.682354:0:14169:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562471.682572:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199360:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 262us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.682579:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:2.0:1783562471.685537:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.685736:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199488 00000100:00100000:3.0:1783562471.685750:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199488 00000100:00100000:3.0:1783562471.685818:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:3.0:1783562471.685830:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199488:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783562471.685933:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.685960:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.685978:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686000:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686008:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686016:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686058:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686069:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686078:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562471.686140:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783562471.686147:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562471.686170:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686186:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686193:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686201:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686208:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.686227:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686236:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686255:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:3.0:1783562471.686259:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.686265:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686272:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8800/0x4738ba0933b894c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686287:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686304:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686311:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686317:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c9e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.686320:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686328:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686337:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bfcd19d2100) 00010000:00010000:3.0:1783562471.686340:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.686343:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686349:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9e00/0x4738ba0933b894cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686699:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686709:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686716:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686721:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.686731:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686738:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686749:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:3.0:1783562471.686752:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562471.686756:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.686764:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8000/0x4738ba0933b894d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.686916:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199488:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 1085us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.686927:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:1.0:1783562471.689705:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.689806:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199744 00000100:00100000:3.0:1783562471.689818:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199744 00000100:00100000:3.0:1783562471.689881:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:3.0:1783562471.689893:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14541:x1870200553199744:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562471.689916:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562471.689942:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b894dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21701 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690078:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690094:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690117:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562471.690129:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783562471.690372:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690381:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690388:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690395:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfd020c8600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562471.690463:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690473:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690488:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:3.0:1783562471.690493:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562471.690500:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.690507:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c8600/0x4738ba0933b894e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.690605:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b894dd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21701 expref: 38 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.690620:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:2.0:1783562471.690628:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562471.690634:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9400/0x4738ba0933b894dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21701 expref: 38 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.690648:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfd020c9400, rc 0) 00000100:00100000:2.0:1783562471.690717:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553199744:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 826us (1084us total) trans 8589934623 rc 301/301 00000100:00100000:2.0:1783562471.690726:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:3.0:1783562471.693746:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.693909:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553199872 00000100:00100000:2.0:1783562471.693920:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553199872 00000100:00100000:2.0:1783562471.693984:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:2.0:1783562471.693995:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553199872:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562471.694034:0:15489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562471.694175:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553199872:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 181us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.694185:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:2.0:1783562471.698997:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.699173:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553200128 00000100:00100000:3.0:1783562471.699185:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553200128 00000100:00100000:3.0:1783562471.699272:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:3.0:1783562471.699283:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553200128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562471.699314:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562471.699318:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783562471.699354:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b8949e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216f3 expref: 37 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.699373:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562471.699379:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562471.699396:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b894f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21708 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783562471.700203:0:14169:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1783562471.700211:0:14169:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1783562471.700290:0:14169:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1783562471.700644:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.700663:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.700677:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.700755:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b894f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21708 expref: 39 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.700773:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21708 expref: 38 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.700793:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2100) 00010000:00010000:3.0:1783562471.700795:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562471.700799:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562471.700889:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+38:14541:x1870200553200128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1606us (1903us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1783562471.700898:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:1.0:1783562471.707534:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.707651:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553200384 00000100:00100000:3.0:1783562471.707665:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553200384 00000100:00100000:1.0:1783562471.707884:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:1.0:1783562471.707902:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+38:14541:x1870200553200384:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562471.708006:0:15489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562471.708049:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b894f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21708 expref: 38 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708081:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2100) 00010000:00010000:1.0:1783562471.708106:0:15489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562471.708132:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708148:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708159:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708174:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708182:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708204:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708334:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708342:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708350:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708357:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562471.708362:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708378:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708390:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562471.708393:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562471.708398:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708458:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89507 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708471:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708478:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708484:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708490:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562471.708494:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708502:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708524:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xac16b161 (ffff9bfcc9774c00) 00010000:00010000:1.0:1783562471.708527:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562471.708530:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.708546:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8950e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac16b161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.708664:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553200384:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 768us (1141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562471.708674:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:2.0:1783562471.713546:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.713618:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553200512 00000100:00100000:3.0:1783562471.713629:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553200512 00000100:00100000:3.0:1783562471.713686:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:3.0:1783562471.713695:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14541:x1870200553200512:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562471.713716:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562471.713738:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89515 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2170f expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713773:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713789:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713801:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713968:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89515 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 39 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713990:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 38 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.713998:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:3.0:1783562471.714001:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783562471.714004:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:3.0:1783562471.714067:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+38:14541:x1870200553200512:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 373us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.714071:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:3.0:1783562471.716746:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.717111:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553200768 00000100:00100000:0.0:1783562471.717121:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553200768 00000100:00100000:0.0:1783562471.717181:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:0.0:1783562471.717199:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+38:14541:x1870200553200768:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783562471.717301:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.717331:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.717344:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562471.718025:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1783562471.718040:0:14171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280974636183ns, next at 281974633533ns, rc = 0 00000004:00010000:0.0:1783562471.718142:0:14171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042cba217 reply state 00000000982e21a2 transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562471.718152:0:14171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562471.718297:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+40:14541:x1870200553200768:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1103us (1553us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1783562471.718307:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00010000:00010000:0.0:1783562471.720564:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.720590:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.720601:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.720608:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562471.720614:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.720623:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1783562471.720629:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.720666:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:0.0:1783562471.720670:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783562471.720676:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.720683:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89523 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.720753:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553200896 00000100:00100000:2.0:1783562471.720764:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553200896 00000100:00100000:2.0:1783562471.720830:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:2.0:1783562471.720842:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14541:x1870200553200896:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562471.720873:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562471.720908:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21716 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.720991:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 40 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.721015:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 40 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.721038:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:2.0:1783562471.721042:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562471.721045:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:2.0:1783562471.721117:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+40:14541:x1870200553200896:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 278us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.721125:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:3.0:1783562471.724337:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.724431:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553201024 00000100:00100000:1.0:1783562471.724446:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553201024 00000100:00080000:0.0:1783562471.724545:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562471.724547:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:1.0:1783562471.724565:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553201024:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783562471.725102:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553201024:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 540us (775us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783562471.725111:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562471.726855:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.726919:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553201280 00000100:00100000:2.0:1783562471.726931:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553201280 00000100:00100000:2.0:1783562471.727003:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:2.0:1783562471.727016:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+40:14541:x1870200553201280:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783562471.727306:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14541:x1870200553201280:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 290us (456us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1783562471.727315:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:0.0:1783562471.728935:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.729018:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553201536 00000100:00100000:2.0:1783562471.729028:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553201536 00000100:00100000:2.0:1783562471.729083:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:2.0:1783562471.729095:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14541:x1870200553201536:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783562471.729227:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14541:x1870200553201536:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.729236:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:3.0:1783562471.730727:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.730817:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553201664 00000100:00100000:0.0:1783562471.730827:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553201664 00000100:00100000:0.0:1783562471.730914:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:0.0:1783562471.730925:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14541:x1870200553201664:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562471.730943:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562471.730964:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fa00/0x4738ba0933b89531 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2171d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731027:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731041:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731056:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562471.731106:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562471.731128:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731160:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fa00/0x4738ba0933b89531 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2171d expref: 43 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731174:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2171d expref: 42 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.731184:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:0.0:1783562471.731187:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783562471.731191:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e600, rc 0) 00000100:00100000:0.0:1783562471.731270:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14541:x1870200553201664:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 346us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562471.731276:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:3.0:1783562471.733459:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.733516:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553201792 00000100:00100000:2.0:1783562471.733544:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553201792 00000100:00100000:2.0:1783562471.733622:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562471.733634:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2361:x1870200553201792:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562471.733654:0:14803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562471.733681:0:14803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21724 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562471.733715:0:14803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f00e6, blocks: 0x1 00010000:00010000:2.0:1783562471.733738:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1783562471.733743:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562471.733754:0:14803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 7 pid: 14803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.733775:0:14803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 7 pid: 14803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.733790:0:14803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336e00, rc 0) 00000100:00100000:2.0:1783562471.733858:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2361:x1870200553201792:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.733863:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:1.0:1783562471.736055:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.736144:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202048 00000100:00100000:0.0:1783562471.736156:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202048 00000100:00100000:0.0:1783562471.736299:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:0.0:1783562471.736311:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14541:x1870200553202048:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783562471.736552:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14541:x1870200553202048:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 239us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562471.736571:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:3.0:1783562471.739229:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.739282:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202176 00000100:00100000:1.0:1783562471.739292:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202176 00000100:00100000:1.0:1783562471.739347:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562471.739357:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:14541:x1870200553202176:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783562471.739372:0:15965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562471.739389:0:15965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2172b expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.739448:0:15965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 8 pid: 14803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.739467:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562471.739471:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562471.739476:0:15965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.739520:0:15965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 8 pid: 14803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.739532:0:15965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 8 pid: 14803 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.739545:0:15965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef5d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15965:1870200563653504:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562471.739630:0:15965:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562471.743151:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.743205:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202304 00000100:00100000:2.0:1783562471.743226:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202304 00010000:00010000:2.0:1783562471.743279:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 9 pid: 14803 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.743316:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1783562471.743324:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2364:x1870200553202304:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562471.743343:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562471.743367:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 9 pid: 14803 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.743379:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 9 pid: 14803 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.743421:0:14832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562471.743425:0:14832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562471.743433:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 9 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.743440:0:14832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 9 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.743472:0:14832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 9 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.743487:0:14832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:14832:1870200563653632:192.168.204.4@tcp:105: 00010000:00010000:3.0:1783562471.743546:0:15965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083715964/0x4738ba0933b8953f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21724 expref: 9 pid: 14803 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.743564:0:15965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef5d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15965:1870200563653504:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562471.743591:0:15965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.743603:0:15965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683400, rc 0) 00000100:00100000:3.0:1783562471.743650:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:14541:x1870200553202176:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 4292us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.743663:0:14832:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd35cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562471.743664:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562471.747433:0:14832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:14832:1870200563653632:192.168.204.4@tcp:105: 00010000:00010000:2.0:1783562471.747467:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562471.747601:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553202304:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 4275us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562471.747612:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562471.752993:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.753511:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202432 00000100:00100000:3.0:1783562471.753526:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202432 00002000:00100000:3.0:1783562471.753580:0:14809:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9bfceed9ed80 x1870200553202432/t0(0) o4->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:312/0 lens 504/0 e 0 to 0 dl 1783562482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783562471.753592:0:14809:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceed9ed80 with x1870200553202432 ext(0->8) 00002000:00010000:3.0:1783562471.753597:0:14809:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfceed9ed80 00000100:00100000:3.0:1783562471.753628:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562471.753639:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553202432:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783562471.754160:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2363:x1870200553202432:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 521us (1176us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783562471.754169:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00002000:00100000:3.0:1783562471.754177:0:14809:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9bfceed9ed80 x1870200553202432/t8589934596(0) o4->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:312/0 lens 504/448 e 0 to 0 dl 1783562482 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783562471.754184:0:14809:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceed9ed80 with x1870200553202432 ext(0->8) 00002000:00010000:3.0:1783562471.754189:0:14809:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfceed9ed80 00000100:00100000:3.0:1783562471.756962:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.757299:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202560 00000100:00100000:1.0:1783562471.757313:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202560 00000100:00100000:1.0:1783562471.757396:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:1.0:1783562471.757432:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14541:x1870200553202560:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783562471.785258:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:0.0:1783562471.785275:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783562471.785310:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14541:x1870200553202560:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 27875us (28353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.785326:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00000001:00080000:0.0:1783562471.785330:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1783562471.785367:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000001:00080000:0.0:1783562471.785393:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1783562471.785467:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563653760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783562471.785542:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562471.785583:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563653760 00000100:00100000:3.0:1783562471.785592:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563653760 00000100:00080000:0.0:1783562471.785718:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562471.785758:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562471.785768:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563653760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783562471.785972:0:14806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783562471.785976:0:14806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783562470 00002000:00010000:3.0:1783562471.785978:0:14806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783562471.785981:0:14806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783562470 -> 1783562470 00002000:00010000:3.0:1783562471.785983:0:14806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783562471.786020:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563653760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (478us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783562471.786027:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783562471.786115:0:3273:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1783562471.786135:0:3273:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bfceed9f480 x1870200563653760/t8589934597(8589934597) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783562487 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783562471.786147:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfceed9f480/2, rc 0, transno 8589934597 00000100:00100000:1.0:1783562471.786151:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563653760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783562471.788956:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.789145:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202688 00000100:00100000:3.0:1783562471.789156:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202688 00000100:00100000:3.0:1783562471.789271:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562471.789284:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2364:x1870200553202688:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783562471.806079:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1783562471.806100:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1783562471.806105:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:3.0:1783562471.806233:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553202688:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 16946us (17288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.806246:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:1.0:1783562471.808219:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.808281:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553202944 00000100:00100000:2.0:1783562471.808293:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553202944 00000100:00100000:2.0:1783562471.808343:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:2.0:1783562471.808351:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:14541:x1870200553202944:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562471.808426:0:15489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562471.808459:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e600/0x4738ba0933b89538 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2171d expref: 13 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.808478:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:2.0:1783562471.808482:0:15489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562471.808522:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.808541:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.808552:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562471.808781:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b537ea76 reply state 000000003fbf377e transno 8589934627 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.808789:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562471.808883:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14541:x1870200553202944:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 531us (680us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1783562471.808892:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00010000:00010000:2.0:1783562471.811293:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811340:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811352:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811359:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562471.811364:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811373:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811392:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:2.0:1783562471.811395:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562471.811433:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.811441:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336000/0x4738ba0933b8954d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.811550:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.811603:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203072 00000100:00100000:2.0:1783562471.811615:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203072 00000100:00100000:2.0:1783562471.811668:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562471.811679:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2363:x1870200553203072:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783562471.812502:0:14803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783562471.812508:0:14803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783562470 -> 1783562469 00002000:00010000:2.0:1783562471.812511:0:14803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783562468 00002000:00010000:2.0:1783562471.812513:0:14803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783562470 -> 1783562469 00002000:00010000:2.0:1783562471.812523:0:14803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783562471.812601:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553203072:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 922us (1055us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783562471.812610:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:0.0:1783562471.813952:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.814043:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203328 00000100:00100000:2.0:1783562471.814053:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203328 00000100:00100000:2.0:1783562471.814110:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:2.0:1783562471.814121:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:14541:x1870200553203328:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783562471.814194:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.814225:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 13 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.814236:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.814278:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 13 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.814293:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 13 pid: 14170 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.814312:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563653888:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562471.814470:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562471.816885:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.816904:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9294a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563653888:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562471.816949:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.817047:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203456 00000100:00100000:3.0:1783562471.817055:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203456 00010000:00010000:3.0:1783562471.817093:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 14 pid: 14170 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.817119:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562471.817126:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:2363:x1870200553203456:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562471.817140:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562471.817146:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 14 pid: 14170 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817189:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 14 pid: 14170 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817227:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b8951c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2170f expref: 14 pid: 14170 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817245:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:3.0:1783562471.817250:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817270:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817279:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.817303:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562471.817331:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817342:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.817364:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:2363:x1870200553203456:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 236us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.817373:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00010000:00010000:2.0:1783562471.817376:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817385:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817393:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817439:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562471.817447:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817455:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817466:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:2.0:1783562471.817470:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783562471.817474:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.817481:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336e00/0x4738ba0933b89554 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.817532:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+12:14541:x1870200553203328:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 3412us (3583us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783562471.817549:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:1.0:1783562471.819760:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.819813:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203584 00000100:00100000:3.0:1783562471.819825:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203584 00000100:00100000:3.0:1783562471.819886:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1783562471.819897:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553203584:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783562471.819945:0:15965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.819985:0:15965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 7 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.819994:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783562471.819998:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783562471.820003:0:15965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.820039:0:15965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 7 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.820055:0:15965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 7 pid: 15965 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.820072:0:15965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15965:1870200563654016:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562471.820156:0:15965:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66adf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562471.823786:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562471.823897:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203712 00000100:00100000:1.0:1783562471.823913:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203712 00000100:00100000:3.0:1783562471.823935:0:15965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15965:1870200563654016:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562471.823969:0:15965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.823970:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.824030:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:1.0:1783562471.824043:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2364:x1870200553203712:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562471.824060:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562471.824089:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.824103:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.824128:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016967519/0x4738ba0933b89546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2172b expref: 8 pid: 15965 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.824145:0:14156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562471.824149:0:14156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562471.824273:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.824285:0:14156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.824320:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562471.824391:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553203712:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 350us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562471.824399:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00010000:00010000:3.0:1783562471.824581:0:15965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824591:0:15965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824629:0:15965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824639:0:15965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824647:0:15965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824655:0:15965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562471.824660:0:15965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824670:0:15965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824684:0:15965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.824691:0:15965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36381dd/0x4738ba0933b8955b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.824742:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553203584:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 4847us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.824758:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:1.0:1783562471.827537:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562471.827595:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553203968 00000100:00100000:0.0:1783562471.827605:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553203968 00000100:00100000:0.0:1783562471.827664:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:0.0:1783562471.827676:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+12:14541:x1870200553203968:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783562471.827763:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.827782:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.827794:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.828090:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.828108:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 13 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.828117:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.828159:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 13 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.828175:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 13 pid: 14169 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562471.828197:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563654144:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562471.828372:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562471.830325:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563654144:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562471.830360:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.830756:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.830839:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553204096 00000100:00100000:3.0:1783562471.830847:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553204096 00010000:00010000:3.0:1783562471.830887:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 14 pid: 14169 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562471.830930:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1783562471.830942:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:2363:x1870200553204096:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562471.830956:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562471.830963:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 14 pid: 14169 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.830973:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 14 pid: 14169 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.830996:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8952a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21716 expref: 14 pid: 14169 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.831013:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:3.0:1783562471.831019:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.831030:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.831038:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.831077:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562471.831123:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:2363:x1870200553204096:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.831129:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00010000:00010000:0.0:1783562471.831161:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.831179:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783562471.831506:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:0.0:1783562471.831681:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:0.0:1783562471.831736:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1783562471.831848:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563654272:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783562471.831955:0:14171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562471.831987:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc29eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562471.832020:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563654272 00000100:00100000:3.0:1783562471.832027:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563654272 00000100:00100000:3.0:1783562471.832057:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562471.832065:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563654272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783562471.832138:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563654272:12345-0@lo:1000:mdt00_002.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562471.832144:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562471.832182:0:14171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1783562471.832190:0:14171:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfceed9f480, transno 8589934597 00000100:00100000:1.0:1783562471.832221:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563654272:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783562471.832990:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1783562471.833061:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563654400:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783562471.833096:0:14171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562471.833130:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562471.833140:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563654400 00000100:00100000:3.0:1783562471.833147:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563654400 00000100:00100000:3.0:1783562471.833189:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562471.833197:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563654400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783562471.833510:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14171:x1870200563654400:12345-0@lo:1000:mdt00_002.0 Request processed in 313us (412us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783562471.833519:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562471.833573:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563654400:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783562471.833611:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833622:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833630:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833648:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562471.833654:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833661:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833678:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2e00) 00010000:00010000:1.0:1783562471.833682:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562471.833686:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833693:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f200/0x4738ba0933b89569 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833739:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833747:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833753:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833756:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562471.833758:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833762:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833776:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:1.0:1783562471.833777:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562471.833780:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833784:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b894a5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833803:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833814:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 16 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833821:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833843:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 16 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.833853:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 16 pid: 15489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.833868:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563654528:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562471.833943:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562471.838481:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563654528:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562471.838523:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562471.840953:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562471.841193:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553204224 00000100:00100000:2.0:1783562471.841207:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553204224 00010000:00010000:2.0:1783562471.841280:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 17 pid: 15489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.841338:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562471.841351:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+17:2363:x1870200553204224:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562471.841386:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562471.841398:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 17 pid: 15489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841450:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 17 pid: 15489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841481:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfd020c9600/0x4738ba0933b894c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c216fa expref: 17 pid: 15489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841501:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:2.0:1783562471.841507:0:14832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841518:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841526:0:14832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562471.841587:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562471.841610:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841623:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841638:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841664:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.841668:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:2363:x1870200553204224:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 317us (739us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562471.841675:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562471.841681:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00010000:00010000:0.0:1783562471.841689:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562471.841696:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841705:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841721:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:0.0:1783562471.841725:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562471.841729:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841735:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89570 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841749:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841755:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841762:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841767:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562471.841775:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841782:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841790:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2000) 00010000:00010000:0.0:1783562471.841793:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783562471.841796:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562471.841803:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f000/0x4738ba0933b89562 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562471.842141:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:14541:x1870200553203968:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 14466us (14613us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1783562471.842150:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00000020:00080000:0.0:1783562471.842154:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783562471.842594:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562471.842600:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562471.842654:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783562471.842663:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783562471.844124:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562471.844204:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553204480 00000100:00100000:3.0:1783562471.844223:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553204480 00000100:00100000:3.0:1783562471.844295:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:3.0:1783562471.844306:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:14541:x1870200553204480:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783562471.845259:0:16314:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783562471.845434:0:16314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934633 00010000:00010000:3.0:1783562471.845496:0:16314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845531:0:16314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845545:0:16314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845556:0:16314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845564:0:16314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845571:0:16314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562471.845598:0:16314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783562471.845720:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+17:14541:x1870200553204480:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1412us (1601us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1783562471.845731:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000020:00080000:3.0:1783562471.845736:0:16314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562471.845876:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562471.845886:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.845904:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562471.845910:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.845920:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.845936:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bfcd19d2f00) 00010000:00010000:1.0:1783562471.845938:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783562471.845943:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.845949:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89577 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562471.845975:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562471.845978:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562471.845979:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562472.503978:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783562473.220910:0:16405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783562473.220929:0:16405:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562473.220973:0:16405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783562473.220979:0:16405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783562473.353283:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.353322:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553204736 00000100:00100000:1.0:1783562473.353332:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553204736 00000100:00100000:1.0:1783562473.353398:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:1.0:1783562473.353426:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+17:14561:x1870200553204736:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562473.353451:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562473.353473:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8957e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21732 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562473.353771:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783562473.353949:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8957e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21732 expref: 19 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.353965:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:1.0:1783562473.353968:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562473.353974:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b8957e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21732 expref: 19 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.353987:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683400, rc 0) 00000100:00100000:1.0:1783562473.354052:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14561:x1870200553204736:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 630us (780us total) trans 8589934635 rc 301/301 00000100:00100000:1.0:1783562473.354060:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00080000:1.0:1783562473.354088:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562473.362275:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.362313:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553204864 00000100:00100000:2.0:1783562473.362323:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553204864 00000100:00100000:2.0:1783562473.362367:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:2.0:1783562473.362376:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14561:x1870200553204864:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:2.0:1783562473.362481:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362500:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362513:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362527:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362534:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362540:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362836:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362845:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.362852:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562473.365142:0:15489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365170:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365177:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365196:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365202:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.365207:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365215:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365235:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562473.365238:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.365243:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365258:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b8958c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365273:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365280:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365286:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365291:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.365294:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365301:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365309:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc4c37a00) 00010000:00010000:2.0:1783562473.365312:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.365315:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365320:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89593 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365340:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365345:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365356:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365362:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.365365:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365372:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365378:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcc4c37e00) 00010000:00010000:2.0:1783562473.365380:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.365382:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.365388:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8959a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.365517:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14561:x1870200553204864:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 3136us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562473.365529:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:1.0:1783562473.373627:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.373857:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553205120 00000100:00100000:2.0:1783562473.373870:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553205120 00000100:00100000:2.0:1783562473.373927:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562473.373938:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14561:x1870200553205120:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562473.374797:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14561:x1870200553205120:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 854us (1179us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1783562473.374807:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562473.414021:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562473.416893:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553205376 00000100:00100000:3.0:1783562473.416910:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553205376 00000100:00100000:3.0:1783562473.416999:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:3.0:1783562473.417011:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14564:x1870200553205376:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562473.417039:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562473.417062:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21739 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417199:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417215:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417227:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417242:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417248:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417254:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417649:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417659:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417667:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562473.417679:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1783562473.417794:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417813:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417820:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417827:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562473.417832:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417840:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417853:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562473.417856:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562473.417862:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417868:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b895a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417882:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417889:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417895:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417900:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562473.417910:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417917:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417925:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd19d2b00) 00010000:00010000:3.0:1783562473.417928:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562473.417931:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417937:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b895af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.417987:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 22 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.418002:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.418009:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:3.0:1783562473.418011:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562473.418014:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562473.418104:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14564:x1870200553205376:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1095us (4095us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1783562473.418112:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:1.0:1783562473.422605:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.422817:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553205504 00000100:00100000:0.0:1783562473.422829:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553205504 00000100:00100000:0.0:1783562473.422929:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1783562473.422939:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14564:x1870200553205504:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:0.0:1783562473.423015:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423036:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423049:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423099:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423105:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423112:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423118:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698fe00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.423122:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423129:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423142:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:0.0:1783562473.423145:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562473.423149:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.423155:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698fe00/0x4738ba0933b895c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562473.423246:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14564:x1870200553205504:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 308us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562473.423254:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:2.0:1783562473.437906:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562473.437989:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553205760 00000100:00100000:3.0:1783562473.438003:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553205760 00000100:00100000:3.0:1783562473.438067:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:3.0:1783562473.438078:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14564:x1870200553205760:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:3.0:1783562473.438376:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:14564:x1870200553205760:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 298us (481us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1783562473.438385:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562473.468105:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.468188:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206016 00000100:00100000:2.0:1783562473.468200:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206016 00000100:00100000:2.0:1783562473.468258:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:2.0:1783562473.468269:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:12102:x1870200553206016:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562473.468295:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562473.468317:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b895cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21740 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.468483:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.468501:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 23 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.468510:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.468546:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 23 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.468560:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 23 pid: 14169 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.468576:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563654656:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562473.468687:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783562473.471613:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.471729:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563654656:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562473.471765:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.471887:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206144 00000100:00100000:3.0:1783562473.471903:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206144 00010000:00010000:3.0:1783562473.472457:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 24 pid: 14169 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.472511:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:3.0:1783562473.472529:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:2363:x1870200553206144:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562473.472808:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562473.472830:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 24 pid: 14169 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.472865:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 24 pid: 14169 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.472892:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b895b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21739 expref: 24 pid: 14169 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.472912:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:0.0:1783562473.472918:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.472929:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.472937:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.473560:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.473572:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562473.473607:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1783562473.473792:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b895cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 25 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.473812:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 24 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.473821:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:1.0:1783562473.473823:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783562473.473826:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336200, rc 0) 00010000:00010000:0.0:1783562473.473849:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562473.473907:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:12102:x1870200553206016:12345-192.168.204.4@tcp:101:bash.0 Request processed in 5638us (5811us total) trans 8589934639 rc 0/0 00000100:00100000:1.0:1783562473.473916:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:0.0:1783562473.474133:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:2363:x1870200553206144:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1611us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562473.474142:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1783562473.476792:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.477044:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206400 00000100:00100000:2.0:1783562473.477057:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206400 00000100:00100000:2.0:1783562473.477188:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:2.0:1783562473.477210:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:12102:x1870200553206400:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:2.0:1783562473.477657:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.477675:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.477687:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562473.478867:0:15489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000004:00010000:2.0:1783562473.478943:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000763907f5 reply state 000000005ba6cb36 transno 8589934641 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.478959:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783562473.479109:0:15489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934641 00000100:00100000:2.0:1783562473.479288:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:12102:x1870200553206400:12345-192.168.204.4@tcp:36:bash.0 Request processed in 2087us (2501us total) trans 8589934642 rc 0/0 00000100:00100000:2.0:1783562473.479299:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000020:00080000:2.0:1783562473.479306:0:15489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1783562473.481774:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481790:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481796:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481821:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.481825:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481830:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481847:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:0.0:1783562473.481849:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.481853:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.481870:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b895e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562473.482507:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562473.482602:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206528 00000100:00100000:3.0:1783562473.482613:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206528 00000100:00100000:3.0:1783562473.482671:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:3.0:1783562473.482684:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:12102:x1870200553206528:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562473.482712:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562473.482732:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21747 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.482801:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21747 expref: 27 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.482815:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21747 expref: 27 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.482834:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:3.0:1783562473.482836:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783562473.482849:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3800, rc 0) 00000100:00100000:3.0:1783562473.482929:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:12102:x1870200553206528:12345-192.168.204.4@tcp:101:bash.0 Request processed in 248us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562473.482937:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:3.0:1783562473.485316:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.485613:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206656 00000100:00100000:0.0:1783562473.485625:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206656 00000100:00100000:0.0:1783562473.485694:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:0.0:1783562473.485774:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:12102:x1870200553206656:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562473.485796:0:14806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1783562473.485799:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783562473.485819:0:14806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2174e expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562473.485852:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a4f00e5, atime: 0x6a4f00e4, ctime: 0x6a4f00e5, blocks: 0xb 00010000:00010000:0.0:1783562473.485882:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1783562473.485887:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562473.485896:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.485939:0:14806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.485954:0:14806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698fe00, rc 0) 00000100:00100000:0.0:1783562473.486064:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:12102:x1870200553206656:12345-192.168.204.4@tcp:101:bash.0 Request processed in 359us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562473.486072:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562473.488929:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.489043:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553206784 00000100:00100000:0.0:1783562473.489053:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553206784 00002000:00010000:0.0:1783562473.489099:0:14811:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:0.0:1783562473.489104:0:14811:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf637ed80 with x1870200553206784 ext(0->18446744073709551615) 00002000:00010000:0.0:1783562473.489117:0:14811:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf637ed80. 00000100:00100000:0.0:1783562473.489160:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:0.0:1783562473.489171:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553206784:12345-192.168.204.4@tcp:10:bash.0 00002000:00010000:0.0:1783562473.489515:0:14811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783562473.489519:0:14811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783562469 -> 1783562472 00002000:00010000:0.0:1783562473.489521:0:14811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1783562468 -> 1783562468 00002000:00010000:0.0:1783562473.489524:0:14811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783562469 -> 1783562472 00002000:00010000:0.0:1783562473.489526:0:14811:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783562473.489646:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2364:x1870200553206784:12345-192.168.204.4@tcp:10:bash.0 Request processed in 475us (728us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783562473.489654:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00002000:00010000:0.0:1783562473.489658:0:14811:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:0.0:1783562473.489661:0:14811:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfcf637ed80 with x1870200553206784 ext(0->18446744073709551615) 00002000:00010000:0.0:1783562473.489685:0:14811:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bfcf637ed80. 00010000:00010000:0.0:1783562473.528001:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562473.534278:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.534519:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207040 00000100:00100000:0.0:1783562473.534533:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207040 00000100:00100000:0.0:1783562473.534677:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:0.0:1783562473.534690:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:14578:x1870200553207040:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562473.534713:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562473.534735:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b895f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21755 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.535044:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ee00/0x4738ba0933b895fc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.535061:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ee00/0x4738ba0933b895fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.535074:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ee00/0x4738ba0933b895fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562473.535087:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783562473.535300:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b895f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21755 expref: 30 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.535320:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ee00/0x4738ba0933b895fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21755 expref: 29 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.535330:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562473.535333:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562473.535337:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698ee00, rc 0) 00000100:00100000:0.0:1783562473.535516:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:14578:x1870200553207040:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 829us (1254us total) trans 8589934643 rc 0/0 00000100:00100000:0.0:1783562473.535525:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:3.0:1783562473.540445:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.540493:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207168 00000100:00100000:1.0:1783562473.540507:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207168 00000100:00100000:1.0:1783562473.540581:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:1.0:1783562473.540593:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:14578:x1870200553207168:12345-192.168.204.4@tcp:34:lfs.0 00010000:00010000:1.0:1783562473.540698:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.540719:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.540753:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.540772:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.540779:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.540786:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541079:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541089:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541095:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562473.541134:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541145:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541152:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541159:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541192:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562473.541197:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541205:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541218:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562473.541221:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562473.541226:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541232:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b8960a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541246:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541253:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541258:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541263:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562473.541265:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541271:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541289:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562473.541292:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562473.541295:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541301:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89611 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541314:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541320:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541325:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541329:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562473.541332:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541337:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541357:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:1.0:1783562473.541360:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562473.541364:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.541369:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89618 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562473.541516:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:14578:x1870200553207168:12345-192.168.204.4@tcp:34:lfs.0 Request processed in 924us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562473.541525:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:2.0:1783562473.579168:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.579570:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207424 00000100:00100000:0.0:1783562473.579582:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207424 00000100:00100000:0.0:1783562473.579676:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:0.0:1783562473.579686:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+29:14581:x1870200553207424:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562473.579707:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562473.579729:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b8961f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2175c expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579816:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579830:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579841:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579853:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579866:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.579870:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580222:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b89634 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580240:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b89634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580247:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b89634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562473.580544:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783562473.580654:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580662:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580668:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580674:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.580680:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580687:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580699:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562473.580703:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.580707:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580713:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89626 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580727:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580740:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580746:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580751:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.580753:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580759:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580766:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd860cf00) 00010000:00010000:0.0:1783562473.580769:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.580771:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580777:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b8962d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580841:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b8961f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2175c expref: 32 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580855:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b89634 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2175c expref: 31 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.580863:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:0.0:1783562473.580865:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783562473.580873:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e000, rc 0) 00000100:00100000:0.0:1783562473.580957:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14581:x1870200553207424:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1271us (1803us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1783562473.580966:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:3.0:1783562473.588821:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.589145:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207552 00000100:00100000:1.0:1783562473.589166:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207552 00000100:00100000:1.0:1783562473.589249:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:1.0:1783562473.589261:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14581:x1870200553207552:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562473.589582:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.589603:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 31 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.589613:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.589650:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 31 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.589664:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 31 pid: 14170 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562473.589681:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563654784:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562473.589859:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd8f000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562473.593546:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.593582:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563654784:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562473.593621:0:14169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.593705:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207808 00000100:00100000:2.0:1783562473.593714:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207808 00000100:00100000:2.0:1783562473.593781:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562473.593792:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:13705:x1870200553207808:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783562473.594260:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+33:13705:x1870200553207808:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 467us (728us total) trans 8589934645 rc 0/0 00000100:00100000:2.0:1783562473.594279:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562473.598339:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.598459:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553207936 00000100:00100000:1.0:1783562473.598472:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553207936 00010000:00010000:1.0:1783562473.598529:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 33 pid: 14170 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562473.598580:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1783562473.598593:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+33:2363:x1870200553207936:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562473.598614:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562473.598623:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 33 pid: 14170 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598639:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 33 pid: 14170 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598666:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b895d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21740 expref: 33 pid: 14170 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598685:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:1.0:1783562473.598691:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598701:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598710:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.598742:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562473.598833:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:2363:x1870200553207936:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 242us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562473.598841:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00010000:00010000:3.0:1783562473.598890:0:14169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598903:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598944:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598952:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598961:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598967:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562473.598973:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598980:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.598990:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:3.0:1783562473.599000:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562473.599004:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.599010:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89642 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.599058:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14581:x1870200553207552:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 9799us (10252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562473.599069:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:3.0:1783562473.601063:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.601128:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553208192 00000100:00100000:2.0:1783562473.601139:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553208192 00000100:00100000:2.0:1783562473.601202:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562473.601214:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+31:14581:x1870200553208192:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562473.601508:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14581:x1870200553208192:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 297us (456us total) trans 8589934646 rc 0/0 00000100:00100000:2.0:1783562473.601514:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1783562473.673495:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.673692:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553208448 00000100:00100000:0.0:1783562473.673702:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553208448 00000100:00100000:0.0:1783562473.673772:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:0.0:1783562473.673785:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+32:14592:x1870200553208448:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562473.673821:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562473.673850:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b89649 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21763 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.673955:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.673972:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.673984:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.673999:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.674007:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.674014:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675357:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8965e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675382:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8965e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675393:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8965e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562473.675431:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1783562473.675554:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675563:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675572:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675579:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.675584:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675592:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675673:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562473.675676:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.675681:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675688:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b89650 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675703:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675717:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675723:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675729:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.675732:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675739:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675747:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd860cf00) 00010000:00010000:0.0:1783562473.675749:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.675751:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675757:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b89657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675838:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b89649 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21763 expref: 35 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675852:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8965e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21763 expref: 34 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.675858:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:0.0:1783562473.675861:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562473.675870:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e800, rc 0) 00000100:00100000:0.0:1783562473.675964:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+34:14592:x1870200553208448:12345-192.168.204.4@tcp:101:cat.0 Request processed in 2180us (2485us total) trans 8589934647 rc 0/0 00000100:00100000:0.0:1783562473.675974:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:1.0:1783562473.682858:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.683200:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553208704 00000100:00100000:2.0:1783562473.683215:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553208704 00000100:00100000:2.0:1783562473.683303:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562473.683315:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+34:14592:x1870200553208704:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:2.0:1783562473.683772:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14592:x1870200553208704:12345-192.168.204.4@tcp:35:cat.0 Request processed in 457us (924us total) trans 8589934648 rc 0/0 00000100:00100000:2.0:1783562473.683780:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1783562473.711320:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.711939:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553208960 00000100:00100000:2.0:1783562473.711957:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553208960 00000100:00100000:2.0:1783562473.712054:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:2.0:1783562473.712069:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14593:x1870200553208960:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1783562473.712144:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783562473.712193:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b8965e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21763 expref: 35 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712248:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e000/0x4738ba0933b89634 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2175c expref: 34 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712263:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b895e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21747 expref: 33 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712276:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcd19d2300) 00010000:00010000:2.0:1783562473.712291:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562473.712322:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712339:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712352:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712370:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712376:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712383:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712798:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712808:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.712823:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562473.713795:0:14170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:2.0:1783562473.713807:0:14170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282970403739ns, next at 283970401050ns, rc = 0 00010000:00010000:2.0:1783562473.713891:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.713902:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.713912:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.713920:0:14170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.713928:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.713935:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714007:0:14170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562473.714055:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714062:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714068:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714083:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.714088:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714096:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714107:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcc4c37a00) 00010000:00010000:2.0:1783562473.714110:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783562473.714113:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714119:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b8967a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714139:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714145:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714151:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714156:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.714159:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714164:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714197:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562473.714200:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.714202:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.714208:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8966c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562473.714221:0:14170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ef46022 reply state 00000000753b7ca5 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.714231:0:14170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562473.714452:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+34:14593:x1870200553208960:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2338us (3099us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1783562473.714467:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00010000:00010000:1.0:1783562473.715018:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562473.715029:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.715037:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562473.715042:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.715049:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.715061:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bfcc4c37a00) 00010000:00010000:1.0:1783562473.715063:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783562473.715067:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.715074:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b89681 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.715094:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562473.715096:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562473.715097:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562473.722733:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722759:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722778:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722786:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.722791:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722801:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722852:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc4c37e00) 00010000:00010000:2.0:1783562473.722856:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.722861:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.722868:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89673 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.755595:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.755768:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553209216 00000100:00100000:2.0:1783562473.755780:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553209216 00000100:00100000:2.0:1783562473.755848:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:2.0:1783562473.755858:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+33:14599:x1870200553209216:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562473.755884:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562473.755907:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89688 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2176a expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756068:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756087:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756102:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756117:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756124:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756161:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756908:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756919:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756928:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562473.756940:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783562473.756970:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756977:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756984:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.756990:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.756995:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.757002:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.757015:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562473.757018:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.757030:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.757035:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b8968f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783562473.757051:0:15489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2b80385 reply state 000000008a81f937 transno 8589934650 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.757060:0:15489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783562473.757095:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89688 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 36 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.757110:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 35 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.757118:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562473.757120:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783562473.757123:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336c00, rc 0) 00000100:00100000:2.0:1783562473.757227:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14599:x1870200553209216:12345-192.168.204.4@tcp:101:bash.0 Request processed in 1368us (1643us total) trans 8589934650 rc 0/0 00000100:00100000:2.0:1783562473.757235:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00010000:00010000:0.0:1783562473.761077:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761100:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761109:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761116:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562473.761122:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761136:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761159:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc4c37e00) 00010000:00010000:0.0:1783562473.761162:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562473.761167:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.761184:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b89696 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.761202:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.761291:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553209344 00000100:00100000:1.0:1783562473.761304:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553209344 00000100:00100000:1.0:1783562473.761361:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:1.0:1783562473.761369:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+35:14599:x1870200553209344:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:1.0:1783562473.761392:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562473.761436:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b896ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21771 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761496:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761506:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761516:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562473.761551:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783562473.761554:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562473.761567:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761575:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761589:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b896ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 37 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761599:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 36 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.761604:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562473.761605:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783562473.761608:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683400, rc 0) 00000100:00100000:1.0:1783562473.761659:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14599:x1870200553209344:12345-192.168.204.4@tcp:101:bash.0 Request processed in 290us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562473.761676:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:3.0:1783562473.763612:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.763901:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553209600 00000100:00100000:2.0:1783562473.763911:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553209600 00000100:00100000:2.0:1783562473.763977:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562473.763989:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+36:14599:x1870200553209600:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:2.0:1783562473.764443:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14599:x1870200553209600:12345-192.168.204.4@tcp:35:bash.0 Request processed in 455us (839us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1783562473.764453:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1783562473.847273:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562473.847441:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562473.847531:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563654912 00000100:00100000:0.0:1783562473.847542:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563654912 00000100:00080000:1.0:1783562473.847816:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562473.848196:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783562473.848206:0:14808:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783562473.848215:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563654912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562473.848220:0:14808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1783562473.848281:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562473.848365:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562473.848374:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783562473.848479:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfbc9297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562473.854862:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.854983:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553209856 00000100:00100000:0.0:1783562473.854995:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553209856 00000100:00100000:0.0:1783562473.855078:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:0.0:1783562473.855086:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14612:x1870200553209856:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562473.855109:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562473.855129:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b896b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21778 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.855273:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b896c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.855291:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b896c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.855303:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b896c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562473.855316:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783562473.855615:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b896b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21778 expref: 40 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.855633:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b896c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21778 expref: 39 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.855660:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562473.855663:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783562473.855667:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f800, rc 0) 00000100:00100000:0.0:1783562473.855856:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14612:x1870200553209856:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 769us (1006us total) trans 8589934652 rc 0/0 00000100:00100000:0.0:1783562473.855864:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:1.0:1783562473.858574:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562473.858676:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553209984 00000100:00100000:3.0:1783562473.858688:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553209984 00000100:00100000:3.0:1783562473.858752:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:3.0:1783562473.858763:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14612:x1870200553209984:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:3.0:1783562473.858848:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858869:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858884:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858938:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858946:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858953:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858960:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562473.858964:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858971:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.858987:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562473.858990:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562473.858995:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.859001:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.859093:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14612:x1870200553209984:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 331us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562473.859100:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:3.0:1783562473.917122:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.917564:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553210240 00000100:00100000:2.0:1783562473.917576:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553210240 00000100:00100000:2.0:1783562473.919542:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:2.0:1783562473.919574:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14622:x1870200553210240:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:2.0:1783562473.919603:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562473.919633:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b896d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2177f expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.919761:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920428:0:15489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920438:0:15489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 40 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920448:0:15489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920492:0:15489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 40 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920510:0:15489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 40 pid: 14169 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.920526:0:15489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563655040:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562473.920745:0:15489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.920755:0:15489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.920775:0:15489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563655168:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562473.920801:0:15489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562473.925551:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.925680:0:15489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563655040:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562473.925697:0:15489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15489:1870200563655168:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562473.925728:0:15489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.925774:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553210368 00000100:00100000:3.0:1783562473.925783:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553210368 00010000:00010000:3.0:1783562473.925845:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 41 pid: 14169 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.925889:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:3.0:1783562473.925900:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:2362:x1870200553210368:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562473.925916:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562473.925923:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 41 pid: 14169 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.925937:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 41 pid: 14169 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.925961:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21771 expref: 41 pid: 14169 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.925976:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562473.925981:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.925989:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.925996:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562473.926058:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+40:2362:x1870200553210368:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 159us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562473.926066:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:1.0:1783562473.926448:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562473.926580:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553210496 00000100:00100000:2.0:1783562473.926585:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553210496 00010000:00010000:2.0:1783562473.926608:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.926675:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:2.0:1783562473.926683:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+40:2361:x1870200553210496:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562473.926693:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562473.926699:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926709:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926736:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8969d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2176a expref: 40 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926749:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562473.926754:0:14832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926762:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926769:0:14832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.926800:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562473.926829:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:2361:x1870200553210496:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562473.926835:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00010000:00010000:0.0:1783562473.926893:0:15489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.926902:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562473.926925:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783562473.927119:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b896d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 40 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.927135:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 39 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.927143:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562473.927146:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562473.927149:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336400, rc 0) 00000100:00100000:0.0:1783562473.927203:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14622:x1870200553210240:12345-192.168.204.4@tcp:101:bash.0 Request processed in 7644us (10092us total) trans 8589934653 rc 0/0 00000100:00100000:0.0:1783562473.927212:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:2.0:1783562473.931514:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562473.931656:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553210752 00000100:00100000:3.0:1783562473.931665:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553210752 00000100:00100000:3.0:1783562473.931746:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:3.0:1783562473.931757:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+39:14622:x1870200553210752:12345-192.168.204.4@tcp:36:bash.0 00010000:00010000:3.0:1783562473.932098:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.932114:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.932124:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783562473.932165:0:14169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:3.0:1783562473.932201:0:14169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff740769 reply state 0000000083f08f46 transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.932210:0:14169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783562473.932316:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14622:x1870200553210752:12345-192.168.204.4@tcp:36:bash.0 Request processed in 560us (811us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1783562473.932324:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00000020:00080000:3.0:1783562473.932330:0:14169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783562473.934630:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934649:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934658:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934663:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562473.934669:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934697:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934718:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562473.934720:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562473.934726:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.934732:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b896ea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562473.936549:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.936581:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553210880 00000100:00100000:0.0:1783562473.936601:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553210880 00000100:00100000:0.0:1783562473.936656:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:0.0:1783562473.936667:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14622:x1870200553210880:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562473.936690:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562473.936709:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b896f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21786 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.936788:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.936801:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 42 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.936810:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.936839:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 42 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562473.936852:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 42 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562473.936866:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563655296:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562473.937068:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783562473.940772:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562473.940998:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7120380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563655296:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562473.941030:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.942797:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211008 00000100:00100000:3.0:1783562473.942814:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211008 00010000:00010000:3.0:1783562473.942866:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 43 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562473.942956:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:3.0:1783562473.942966:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+43:2363:x1870200553211008:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562473.942994:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562473.943002:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 43 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943034:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 43 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943063:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b896dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2177f expref: 43 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943082:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562473.943086:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943095:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943102:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562473.943141:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562473.943221:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:2363:x1870200553211008:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 256us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562473.943229:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00010000:00010000:2.0:1783562473.943310:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.943320:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562473.943378:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783562473.943384:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562473.943437:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.943475:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ec00/0x4738ba0933b896f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 42 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.943492:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 41 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562473.943514:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562473.943517:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562473.943520:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f400, rc 0) 00000100:00100000:2.0:1783562473.943553:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14622:x1870200553210880:12345-192.168.204.4@tcp:101:bash.0 Request processed in 6887us (7014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562473.943561:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:3.0:1783562473.947088:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.947310:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211264 00000100:00100000:1.0:1783562473.947321:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211264 00000100:00100000:1.0:1783562473.947549:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1783562473.947562:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+41:14622:x1870200553211264:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:1.0:1783562473.947876:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14622:x1870200553211264:12345-192.168.204.4@tcp:35:bash.0 Request processed in 316us (798us total) trans 8589934656 rc 0/0 00000100:00100000:1.0:1783562473.947884:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:0.0:1783562473.997822:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562473.998129:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211392 00000100:00100000:1.0:1783562473.998140:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211392 00000100:00100000:1.0:1783562473.998219:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:1.0:1783562473.998229:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+42:14628:x1870200553211392:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562473.998267:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562473.998297:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2178d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998369:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998386:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998399:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562473.998523:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783562473.998528:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562473.998551:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998579:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b896ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2178d expref: 44 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998600:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2178d expref: 43 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562473.998609:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562473.998612:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562473.998615:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683e00, rc 0) 00000100:00100000:1.0:1783562473.998822:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+43:14628:x1870200553211392:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 593us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562473.998830:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:3.0:1783562474.001823:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.001938:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211520 00000100:00100000:2.0:1783562474.001948:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211520 00000100:00100000:2.0:1783562474.002011:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:2.0:1783562474.002020:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+43:14628:x1870200553211520:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562474.002043:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562474.002071:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8970d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21794 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002147:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002163:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002245:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002263:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002271:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002295:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002486:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002496:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002502:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562474.002633:0:15489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783562474.002636:0:15489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562474.002650:0:15489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002658:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002663:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002667:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002671:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002675:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562474.002678:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002689:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002702:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562474.002705:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562474.002709:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002715:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89714 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002731:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002737:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002744:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002749:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562474.002752:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002759:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002766:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562474.002769:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562474.002772:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002800:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b8971b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002835:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8970d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002847:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 44 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.002854:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562474.002856:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562474.002858:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337800, rc 0) 00000100:00100000:2.0:1783562474.002932:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553211520:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 912us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.002939:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:3.0:1783562474.006215:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562474.006322:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211776 00000100:00100000:1.0:1783562474.006333:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211776 00000100:00100000:1.0:1783562474.006400:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:1.0:1783562474.006443:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553211776:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:1.0:1783562474.006473:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562474.006499:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89729 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2179b expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006657:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006683:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006692:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006700:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006749:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.006764:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.006779:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563655424:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562474.007189:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.007199:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.007208:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563655552:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562474.007988:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd8f000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562474.008074:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.008123:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553211904 00000100:00100000:2.0:1783562474.008132:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553211904 00010000:00010000:2.0:1783562474.008167:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 46 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562474.008215:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562474.008226:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:2361:x1870200553211904:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562474.008240:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562474.008249:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 46 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.008279:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 46 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.008304:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562474.008309:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.008317:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.008323:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562474.008365:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:2361:x1870200553211904:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 140us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.008373:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00010000:00010000:1.0:1783562474.010014:0:14169:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.4@tcp) returned -22 from blocking AST (req@000000008ea5c0bf x1870200563655424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010044:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b89722 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21794 expref: 45 pid: 15489 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.010062:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563655424:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562474.010078:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563655552:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562474.010100:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562474.010106:0:14169:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010115:0:14169:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010124:0:14169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562474.010358:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562474.010430:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212032 00000100:00100000:1.0:1783562474.010437:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212032 00010000:00010000:1.0:1783562474.010467:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.010605:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:1.0:1783562474.010616:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:2363:x1870200553212032:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562474.010629:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562474.010636:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010659:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010678:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f400/0x4738ba0933b896f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21786 expref: 45 pid: 14171 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010700:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562474.010705:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010713:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010720:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.010750:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562474.010803:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:2363:x1870200553212032:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 185us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562474.010811:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00010000:00010000:2.0:1783562474.010857:0:14169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.010865:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562474.010885:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783562474.011042:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89729 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 45 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.011058:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 44 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.011065:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562474.011074:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562474.011077:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683600, rc 0) 00000100:00100000:2.0:1783562474.011120:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553211776:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 4681us (4915us total) trans 8589934657 rc 0/0 00000100:00100000:2.0:1783562474.011127:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:0.0:1783562474.013987:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.014211:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212416 00000100:00100000:3.0:1783562474.014224:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212416 00000100:00100000:3.0:1783562474.014327:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:3.0:1783562474.014339:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553212416:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:3.0:1783562474.014670:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14628:x1870200553212416:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 332us (691us total) trans 8589934658 rc 0/0 00000100:00100000:3.0:1783562474.014678:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:0.0:1783562474.016971:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.017052:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212544 00000100:00100000:2.0:1783562474.017062:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212544 00000100:00100000:2.0:1783562474.017237:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:2.0:1783562474.017251:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14628:x1870200553212544:12345-192.168.204.4@tcp:103:lfs.0 00010000:00010000:2.0:1783562474.017269:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562474.017301:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698f800/0x4738ba0933b896c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21778 expref: 45 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.017323:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562474.017330:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562474.017392:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553212544:12345-192.168.204.4@tcp:103:lfs.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.017436:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:0.0:1783562474.019756:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.020041:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212672 00000100:00100000:2.0:1783562474.020052:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212672 00000100:00100000:2.0:1783562474.020100:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:2.0:1783562474.020109:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553212672:12345-192.168.204.4@tcp:58:lfs.0 00010000:00010000:2.0:1783562474.020759:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.020782:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.020807:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562474.021346:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:2.0:1783562474.021563:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553212672:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 1452us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.021574:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:0.0:1783562474.023548:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.023596:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212800 00000100:00100000:2.0:1783562474.023609:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212800 00000100:00100000:2.0:1783562474.023679:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:2.0:1783562474.023804:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+44:14628:x1870200553212800:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562474.023827:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562474.023851:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217a2 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.023922:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.023935:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 45 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.023964:0:14170:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.023981:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 45 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.023995:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562474.024014:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562474.024019:0:14170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 45 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.024027:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336800, rc 0) 00000100:00100000:2.0:1783562474.024098:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14628:x1870200553212800:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 410us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.024106:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:3.0:1783562474.358727:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563655680:0@lo:400:kworker.0 00000100:00100000:1.0:1783562474.358740:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562474.358764:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563655808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562474.358847:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562474.358850:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562474.358908:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563655808 00000100:00100000:0.0:1783562474.358921:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563655808 00000100:00100000:1.0:1783562474.358942:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563655936:0@lo:400:kworker.0 00000100:00100000:3.0:1783562474.358954:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563656192:0@lo:400:kworker.0 00000100:00100000:2.0:1783562474.358979:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563655680 00000100:00100000:1.0:1783562474.358984:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562474.358987:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563655680 00000100:00100000:0.0:1783562474.358997:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562474.359003:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562474.359012:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563655808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783562474.359014:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562474.359025:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563656320:0@lo:400:kworker.0 00000100:00100000:2.0:1783562474.359031:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783562474.359036:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783562474.359041:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3275:x1870200563655680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562474.359048:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563656064:0@lo:400:kworker.0 00002000:00000024:0.0:1783562474.359048:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562474.359101:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562474.359107:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563655808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562474.359114:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562474.359120:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3275:x1870200563655680:12345-0@lo:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.359130:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783562474.359138:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562474.359174:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563656192 00000100:00100000:0.0:1783562474.359179:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563656192 00000100:00100000:1.0:1783562474.359188:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563655808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562474.359189:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563655680:0@lo:400:kworker.0 00000100:00100000:2.0:1783562474.359190:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563656320 00000100:00100000:2.0:1783562474.359197:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563656320 00000100:00100000:0.0:1783562474.359219:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563656064 00000100:00080000:1.0:1783562474.359230:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562474.359231:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783562474.359231:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563656064 00000100:00080000:1.0:1783562474.359239:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562474.359245:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563656192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562474.359248:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563655936 00000100:00100000:3.0:1783562474.359254:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563655936 00000100:00100000:0.0:1783562474.359265:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783562474.359275:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563656320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562474.359292:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563656192:12345-0@lo:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.359298:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562474.359306:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562474.359315:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563655936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562474.359316:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783562474.359327:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563656064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562474.359336:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563656320:12345-0@lo:400:kworker.0 Request processed in 63us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562474.359343:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562474.359350:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563656320:0@lo:400:kworker.0 00000100:00100000:1.0:1783562474.359378:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563655936:0@lo:400:kworker.0 00000100:00100000:3.0:1783562474.359387:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3273:x1870200563655936:12345-0@lo:400:kworker.0 Request processed in 72us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.359388:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563656064:12345-0@lo:400:kworker.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.359432:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562474.359435:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783562474.359470:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563656064:0@lo:400:kworker.0 00000100:00100000:3.0:1783562474.359483:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563656192:0@lo:400:kworker.0 00010000:00010000:3.0:1783562474.550610:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783562474.934709:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562474.934718:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562474.934754:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1783562474.934760:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783562474.934886:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563656448:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562474.935087:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f240 going to sleep for 11 seconds 00000100:00100000:0.0:1783562474.939122:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.939218:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563656448:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783562474.942487:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553212928 00000100:00100000:1.0:1783562474.942502:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553212928 00000100:00100000:0.0:1783562474.942729:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562474.942772:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562474.942793:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562474.942812:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213184 00000100:00100000:0.0:1783562474.942816:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213184 00000100:00100000:0.0:1783562474.942868:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213312 00000100:00100000:0.0:1783562474.942872:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213312 00000100:00100000:0.0:1783562474.942892:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:0.0:1783562474.942901:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2363:x1870200553213184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562474.942971:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2363:x1870200553213184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.943054:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562474.943067:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2364:x1870200553213312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562474.943109:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2364:x1870200553213312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.943116:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1783562474.943205:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213056 00000100:00100000:3.0:1783562474.943209:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213056 00000100:00100000:0.0:1783562474.943235:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562474.943239:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:3.0:1783562474.943245:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2364:x1870200553213056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:0.0:1783562474.943254:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562474.943272:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2364:x1870200553213056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.943279:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:3.0:1783562474.943368:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.943383:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213568 00000100:00100000:3.0:1783562474.943386:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213568 00000100:00080000:0.0:1783562474.943428:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562474.943443:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:3.0:1783562474.943450:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553213568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562474.943450:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.943474:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553213568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.943480:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562474.944124:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562474.944144:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213696 00000100:00100000:0.0:1783562474.944149:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213696 00000100:00100000:0.0:1783562474.944198:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562474.944206:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2363:x1870200553213696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562474.944355:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2363:x1870200553213696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 148us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562474.944363:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00080000:0.0:1783562474.944383:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562474.944739:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213440 00000100:00100000:1.0:1783562474.944746:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213440 00000100:00100000:1.0:1783562474.944789:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562474.944797:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2363:x1870200553213440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562474.944839:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2363:x1870200553213440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562474.944847:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562474.944860:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:1.0:1783562474.944867:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14629:x1870200553212928:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783562474.944888:0:14170:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783562474.944967:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14629:x1870200553212928:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 100us (5859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562474.944988:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00080000:0.0:1783562474.945339:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562474.948201:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562474.948308:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553213824 00000100:00100000:1.0:1783562474.948321:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553213824 00000100:00100000:1.0:1783562474.948535:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:1.0:1783562474.948548:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14629:x1870200553213824:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783562474.948655:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948674:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948690:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948743:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948754:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948762:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948789:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948798:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948805:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562474.948857:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783562474.948862:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562474.948883:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948896:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948908:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948916:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948923:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.948928:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948938:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948951:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:1.0:1783562474.948954:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562474.948959:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948965:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b8974c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.948994:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949001:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949008:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949014:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.949023:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949030:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949038:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562474.949041:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562474.949044:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949050:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89753 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949073:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949080:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949088:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949093:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.949096:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949102:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949110:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562474.949112:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562474.949120:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.949126:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b8975a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.949345:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14629:x1870200553213824:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 798us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562474.949354:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:0.0:1783562474.952188:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.952336:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553214080 00000100:00100000:3.0:1783562474.952349:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553214080 00000100:00100000:3.0:1783562474.952447:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:3.0:1783562474.952458:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+45:14629:x1870200553214080:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562474.952481:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562474.952501:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89761 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217a9 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952633:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952650:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952664:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562474.952799:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783562474.952905:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952913:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952921:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952928:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562474.952933:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952940:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952954:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562474.952957:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783562474.952961:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.952978:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89768 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.953025:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89761 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a9 expref: 47 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.953035:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:3.0:1783562474.953037:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562474.953041:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89761 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a9 expref: 47 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.953051:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3c00, rc 0) 00000100:00100000:3.0:1783562474.953244:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214080:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 787us (1068us total) trans 8589934659 rc 301/301 00000100:00100000:3.0:1783562474.953262:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:3.0:1783562474.956120:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.956210:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553214208 00000100:00100000:2.0:1783562474.956220:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553214208 00000100:00100000:2.0:1783562474.956284:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:2.0:1783562474.956294:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214208:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562474.956333:0:14171:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562474.956491:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214208:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 198us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.956500:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:0.0:1783562474.958736:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.959316:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553214464 00000100:00100000:3.0:1783562474.959330:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553214464 00000100:00100000:3.0:1783562474.959398:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:3.0:1783562474.959446:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214464:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783562474.959470:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562474.959473:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783562474.959503:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89706 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2178d expref: 46 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.959522:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:3.0:1783562474.959543:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562474.959558:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89776 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217b0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783562474.960427:0:14169:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1783562474.960436:0:14169:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1783562474.960482:0:14169:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1783562474.960895:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8977d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.960913:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8977d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.960927:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8977d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.960985:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89776 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b0 expref: 48 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.961007:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8977d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b0 expref: 47 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562474.961014:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcd19d2b00) 00010000:00010000:3.0:1783562474.961017:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562474.961020:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562474.961111:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+47:14629:x1870200553214464:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1669us (2385us total) trans 8589934660 rc 0/0 00000100:00100000:3.0:1783562474.961120:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:0.0:1783562474.967810:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562474.968589:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553214720 00000100:00100000:1.0:1783562474.968612:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553214720 00000100:00100000:1.0:1783562474.968670:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:1.0:1783562474.968678:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+47:14629:x1870200553214720:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783562474.968736:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562474.968763:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8977d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b0 expref: 47 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968784:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcd19d2b00) 00010000:00010000:1.0:1783562474.968795:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562474.968818:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968833:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968841:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968892:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968911:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968915:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968984:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968991:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.968997:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969003:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.969008:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969017:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969026:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:1.0:1783562474.969029:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562474.969032:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969039:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b8978b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969049:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969063:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969068:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969073:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.969077:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969083:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969091:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3eb58411 (ffff9bfcc9774100) 00010000:00010000:1.0:1783562474.969094:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562474.969096:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.969099:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499400/0x4738ba0933b89792 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3eb58411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562474.969189:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214720:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 509us (1390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562474.969198:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:1.0:1783562474.972182:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.972316:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553214848 00000100:00100000:2.0:1783562474.972326:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553214848 00000100:00100000:2.0:1783562474.972392:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:2.0:1783562474.972442:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+46:14629:x1870200553214848:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562474.972465:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562474.972496:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89799 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217b7 expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972541:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972555:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972587:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972693:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b89799 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 48 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972714:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 47 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.972723:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562474.972725:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562474.972729:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:2.0:1783562474.972797:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+47:14629:x1870200553214848:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 395us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.972806:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:0.0:1783562474.975472:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.975508:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553215104 00000100:00100000:2.0:1783562474.975519:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553215104 00000100:00100000:2.0:1783562474.975598:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:2.0:1783562474.975612:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+47:14629:x1870200553215104:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562474.975703:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.975720:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.975735:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562474.976397:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1783562474.976447:0:14171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284233042810ns, next at 285233039790ns, rc = 0 00000004:00010000:2.0:1783562474.976556:0:14171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e90d17fb reply state 00000000603d5938 transno 8589934661 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562474.976568:0:14171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562474.976699:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+49:14629:x1870200553215104:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1087us (1237us total) trans 8589934661 rc 0/0 00000100:00100000:2.0:1783562474.976707:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:0.0:1783562474.980291:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1783562474.980346:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980360:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980386:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980390:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562474.980394:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980400:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980448:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:1.0:1783562474.980450:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783562474.980454:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562474.980460:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b897a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562474.980557:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553215232 00000100:00100000:3.0:1783562474.980572:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553215232 00000100:00100000:0.0:1783562474.980876:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:0.0:1783562474.980886:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+48:14629:x1870200553215232:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562474.980916:0:15489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562474.980933:0:15489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217be expref: -99 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562474.980989:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 49 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562474.980999:0:15489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 49 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562474.981106:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:0.0:1783562474.981108:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562474.981110:0:15489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e800, rc 0) 00000100:00100000:0.0:1783562474.981182:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+49:14629:x1870200553215232:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 297us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562474.981190:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:1.0:1783562474.984777:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.984871:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553215360 00000100:00100000:3.0:1783562474.984882:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553215360 00000100:00100000:3.0:1783562474.985054:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:3.0:1783562474.985067:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2363:x1870200553215360:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783562474.985531:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2363:x1870200553215360:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 465us (766us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783562474.985539:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1783562474.988070:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.988324:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553215616 00000100:00100000:3.0:1783562474.988334:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553215616 00000100:00100000:3.0:1783562474.988567:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:3.0:1783562474.988581:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+49:14629:x1870200553215616:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783562474.988889:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+50:14629:x1870200553215616:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 311us (833us total) trans 8589934662 rc 0/0 00000100:00100000:3.0:1783562474.988898:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:1.0:1783562474.991044:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562474.991385:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553215872 00000100:00100000:3.0:1783562474.991396:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553215872 00000100:00100000:3.0:1783562474.991759:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:3.0:1783562474.991770:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+50:14629:x1870200553215872:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783562474.991922:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+50:14629:x1870200553215872:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 153us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562474.991929:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:0.0:1783562474.994221:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562474.994336:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216000 00000100:00100000:2.0:1783562474.994348:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216000 00000100:00100000:2.0:1783562474.994451:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1783562474.994469:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+50:14629:x1870200553216000:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562474.994491:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562474.994512:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217c5 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994741:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994758:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994771:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562474.994814:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562474.994835:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994869:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217c5 expref: 52 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994888:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217c5 expref: 51 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562474.994896:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562474.994899:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783562474.994903:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336200, rc 0) 00000100:00100000:2.0:1783562474.995081:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+51:14629:x1870200553216000:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 614us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562474.995089:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:1.0:1783562474.999651:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562474.999802:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216128 00000100:00100000:0.0:1783562474.999813:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216128 00000100:00100000:0.0:1783562474.999905:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:0.0:1783562474.999916:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2362:x1870200553216128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562474.999938:0:15965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562474.999962:0:15965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217cc expref: -99 pid: 15965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562474.999992:0:15965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f00e9, blocks: 0x1 00010000:00010000:0.0:1783562475.000012:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1783562475.000031:0:15965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562475.000041:0:15965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 7 pid: 15965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.000060:0:15965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 7 pid: 15965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.000074:0:15965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f600, rc 0) 00000100:00100000:0.0:1783562475.000147:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2362:x1870200553216128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 232us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562475.000162:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1783562475.002894:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562475.003100:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216384 00000100:00100000:2.0:1783562475.003111:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216384 00000100:00100000:2.0:1783562475.003204:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00080000:0.0:1783562475.003206:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562475.003218:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+51:14629:x1870200553216384:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783562475.003347:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+51:14629:x1870200553216384:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 132us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562475.003829:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:1.0:1783562475.007618:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562475.007699:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216512 00000100:00100000:0.0:1783562475.007710:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216512 00000100:00100000:0.0:1783562475.007785:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:0.0:1783562475.007794:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:14629:x1870200553216512:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562475.007816:0:14806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562475.007837:0:14806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217d3 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.007887:0:14806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.007944:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562475.007949:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562475.007955:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 8 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.008021:0:14806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.008036:0:14806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.008051:0:14806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14806:1870200563656576:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562475.008164:0:14806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c540 going to sleep for 11 seconds 00000100:00100000:1.0:1783562475.010607:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562475.010665:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216640 00000100:00100000:2.0:1783562475.010674:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216640 00010000:00010000:2.0:1783562475.010713:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 9 pid: 15965 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.010735:0:14806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14806:1870200563656576:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562475.010750:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:2.0:1783562475.010758:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2363:x1870200553216640:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562475.010764:0:14806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 9 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.010787:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562475.010791:0:14806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698fc00, rc 0) 00000100:00100000:3.0:1783562475.010844:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:14629:x1870200553216512:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 3051us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562475.010850:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00010000:00010000:2.0:1783562475.010907:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.010923:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.010957:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b897c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217cc expref: 8 pid: 15965 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.010970:0:14155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562475.010974:0:14155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562475.010994:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.011006:0:14155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.011037:0:14155:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562475.011052:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14155:1870200563656704:192.168.204.4@tcp:105: 00000100:00100000:2.0:1783562475.011120:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5120e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783562475.012561:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14155:1870200563656704:192.168.204.4@tcp:105: 00010000:00010000:2.0:1783562475.012585:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562475.012650:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553216640:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1892us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562475.012661:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:1.0:1783562475.013827:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562475.013954:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216768 00000100:00100000:3.0:1783562475.013964:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216768 00002000:00100000:3.0:1783562475.014018:0:14809:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9bfceee2f800 x1870200553216768/t0(0) o4->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:316/0 lens 504/0 e 0 to 0 dl 1783562486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783562475.014027:0:14809:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceee2f800 with x1870200553216768 ext(0->12) 00002000:00010000:3.0:1783562475.014032:0:14809:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bfceee2f800 00000100:00100000:3.0:1783562475.014058:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:3.0:1783562475.014067:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553216768:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783562475.015128:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2364:x1870200553216768:12345-192.168.204.4@tcp:4:lhsmtool_posix.0 Request processed in 1053us (1298us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783562475.015143:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00002000:00100000:2.0:1783562475.015164:0:14809:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9bfceee2f800 x1870200553216768/t8589934595(0) o4->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:316/0 lens 504/448 e 0 to 0 dl 1783562486 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1783562475.015175:0:14809:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceee2f800 with x1870200553216768 ext(0->12) 00002000:00010000:2.0:1783562475.015183:0:14809:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bfceee2f800 00000100:00100000:0.0:1783562475.017707:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.017789:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553216896 00000100:00100000:1.0:1783562475.017799:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553216896 00000100:00100000:1.0:1783562475.017885:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:1.0:1783562475.017897:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+51:14629:x1870200553216896:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783562475.044077:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934653 is committed 00000001:00080000:3.0:1783562475.044118:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934656 is committed 00000020:00080000:3.0:1783562475.044136:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcf611be40 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1783562475.044141:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcf611b840 00000020:00080000:3.0:1783562475.044144:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfbc92f4c00 00000001:00080000:3.0:1783562475.044175:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:3.0:1783562475.044180:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783562475.044181:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+37:14629:x1870200553216896:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 26280us (26478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562475.044192:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 102 00000004:00080000:3.0:1783562475.044203:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783562475.044234:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934662 is committed 00000020:00080000:1.0:1783562475.044259:0:14208:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000100:00100000:3.0:1783562475.044449:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562475.044469:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563656832:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1783562475.044510:0:14208:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1783562475.044696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562475.044735:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563656832 00000100:00100000:2.0:1783562475.044745:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563656832 00000100:00100000:2.0:1783562475.044797:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783562475.044806:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563656832:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1783562475.044858:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562475.044933:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563656960:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1783562475.044955:0:14804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783562475.044961:0:14804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783562473 00000100:00100000:3.0:1783562475.044966:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783562475.044967:0:14804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783562475.044971:0:14804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783562473 -> 1783562473 00002000:00010000:2.0:1783562475.044973:0:14804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783562475.045011:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563656960 00000100:00100000:0.0:1783562475.045017:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563656960 00000100:00100000:2.0:1783562475.045036:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3272:x1870200563656832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (340us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783562475.045045:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1783562475.045144:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcef1eaa00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1783562475.045193:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563656832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783562475.045243:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783562475.045248:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1870200563656960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783562475.045262:0:14803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:0.0:1783562475.045279:0:14803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.045295:0:14803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.045301:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783562475.045310:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562475.045314:0:14803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.045335:0:14803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.045344:0:14803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 7 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.045353:0:14803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14803:1870200563657088:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562475.045399:0:14803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562475.047238:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562475.047390:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217024 00000100:00100000:2.0:1783562475.047432:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217024 00000100:00100000:2.0:1783562475.047483:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562475.047672:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2363:x1870200553217024:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783562475.047802:0:14803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14803:1870200563657088:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562475.047829:0:14803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.047941:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562475.047993:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217152 00000100:00100000:0.0:1783562475.047998:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217152 00010000:00010000:0.0:1783562475.048049:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.048073:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1783562475.048080:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2363:x1870200553217152:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562475.048089:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562475.048094:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.048106:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.048146:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b64bf4/0x4738ba0933b895ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2174e expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.048179:0:14832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783562475.048184:0:14832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00000100:00080000:1.0:1783562475.048187:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783562475.048190:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.048201:0:14832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.048234:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783562475.048266:0:14803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.048276:0:14803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.048285:0:14803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.048290:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553217152:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 211us (349us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562475.048294:0:14803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.048298:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00010000:00010000:1.0:1783562475.048311:0:14803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783562475.049691:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3274:x1870200563656960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4435us (4720us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783562475.049705:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1783562475.050082:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562475.050090:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.050119:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562475.050124:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.050136:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.050464:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.050474:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b05ba7da/0x4738ba0933b897d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783562475.050566:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcef1eb100/2, rc 0, transno 8589934601 00000100:00100000:0.0:1783562475.050575:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563656960:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783562475.051454:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562475.051459:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562475.051461:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783562475.077388:0:15961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:3.0:1783562475.077438:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+9:2363:x1870200553217024:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 29939us (30203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562475.077453:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000001:00080000:2.0:1783562475.077570:0:15961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:1.0:1783562475.086682:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562475.086781:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217408 00000100:00100000:3.0:1783562475.086793:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217408 00000100:00100000:3.0:1783562475.086865:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:3.0:1783562475.086877:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:14629:x1870200553217408:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783562475.086946:0:14170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562475.086980:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b897bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217c5 expref: 15 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.087005:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:3.0:1783562475.087011:0:14170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562475.087050:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.087069:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.087082:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783562475.087661:0:14170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000825e6dd1 reply state 00000000088e2e0b transno 8589934663 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.087673:0:14170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783562475.087803:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:14629:x1870200553217408:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 926us (1399us total) trans 8589934663 rc 0/0 00000100:00100000:3.0:1783562475.087814:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 103 00010000:00010000:2.0:1783562475.089674:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089693:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089702:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089709:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562475.089716:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089724:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089748:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:2.0:1783562475.089751:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562475.089756:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.089764:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b897d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.091003:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562475.091166:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217536 00000100:00100000:3.0:1783562475.091178:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217536 00000100:00100000:3.0:1783562475.091258:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:3.0:1783562475.091270:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd13fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553217536:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783562475.091821:0:14806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783562475.091826:0:14806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1783562473 -> 1783562472 00002000:00010000:3.0:1783562475.091829:0:14806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783562472 00002000:00010000:3.0:1783562475.091830:0:14806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783562473 -> 1783562472 00002000:00010000:3.0:1783562475.091832:0:14806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783562475.091926:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd13fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553217536:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 658us (934us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783562475.091934:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:0.0:1783562475.094704:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562475.094763:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217792 00000100:00100000:2.0:1783562475.094775:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217792 00000100:00100000:2.0:1783562475.094853:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:2.0:1783562475.094864:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:14629:x1870200553217792:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783562475.094939:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.094968:0:14169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 15 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.094978:0:14169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.095012:0:14169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 15 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.095027:0:14169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 15 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562475.095042:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563657216:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562475.095160:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562475.099952:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14169:1870200563657216:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562475.100053:0:14169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.102765:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.103062:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553217920 00000100:00100000:1.0:1783562475.103076:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553217920 00010000:00010000:1.0:1783562475.103128:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.103194:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:1.0:1783562475.103206:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:2364:x1870200553217920:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562475.103245:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562475.103254:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103269:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103295:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337e00/0x4738ba0933b897a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217b7 expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103319:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:1.0:1783562475.103325:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103335:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103343:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.103386:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562475.103432:0:14169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103443:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103482:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103500:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.103507:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:2364:x1870200553217920:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 300us (756us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562475.103514:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.103522:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00010000:00010000:0.0:1783562475.103526:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562475.103533:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103543:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103554:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:0.0:1783562475.103557:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783562475.103561:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.103566:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336400/0x4738ba0933b897df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.103615:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14629:x1870200553217792:12345-192.168.204.4@tcp:55:lhsmtool_posix.0 Request processed in 8752us (8928us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783562475.103623:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:0.0:1783562475.107325:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.107646:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218048 00000100:00100000:1.0:1783562475.107658:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218048 00000100:00100000:1.0:1783562475.107722:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:1.0:1783562475.107734:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553218048:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783562475.107819:0:14803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.107839:0:14803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.107846:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562475.107850:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562475.107853:0:14803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.107884:0:14803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.107895:0:14803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 7 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.107908:0:14803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14803:1870200563657344:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562475.108049:0:14803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562475.110556:0:14803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14803:1870200563657344:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562475.110651:0:14803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.111218:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.111305:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218176 00000100:00100000:1.0:1783562475.111313:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218176 00010000:00010000:1.0:1783562475.111347:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.111527:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:1.0:1783562475.111542:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+8:2364:x1870200553218176:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562475.111562:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562475.111704:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.111722:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.111757:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045002023/0x4738ba0933b897ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217d3 expref: 8 pid: 14806 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.111775:0:14156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562475.111780:0:14156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783562475.111788:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.111798:0:14156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.111888:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562475.111963:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553218176:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 424us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562475.111972:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00010000:00010000:3.0:1783562475.112054:0:14803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112064:0:14803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112104:0:14803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112111:0:14803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112119:0:14803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112127:0:14803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562475.112133:0:14803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112143:0:14803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112168:0:14803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.112176:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2ff9da/0x4738ba0933b897e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.112394:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2364:x1870200553218048:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 4662us (5083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562475.112473:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562475.114276:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.114396:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218432 00000100:00100000:1.0:1783562475.114493:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218432 00000100:00100000:1.0:1783562475.114575:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:1.0:1783562475.114592:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:14629:x1870200553218432:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783562475.114724:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.114754:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.114773:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.115093:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.115107:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 15 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.115117:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.115180:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 15 pid: 15489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.115197:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 15 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.115214:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563657472:192.168.204.4@tcp:104: 00000100:00100000:1.0:1783562475.115367:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562475.118926:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.119105:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563657472:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562475.119196:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.119250:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218560 00000100:00100000:3.0:1783562475.119261:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218560 00010000:00010000:3.0:1783562475.119307:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.119354:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562475.119366:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+16:2363:x1870200553218560:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562475.119474:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562475.119485:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119502:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119536:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698e800/0x4738ba0933b897ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217be expref: 16 pid: 15489 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119554:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:3.0:1783562475.119559:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119568:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119573:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.119617:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562475.119669:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:2363:x1870200553218560:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 305us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562475.119679:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00010000:00010000:1.0:1783562475.119732:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.119738:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783562475.119983:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:1.0:1783562475.120145:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000001:00080000:1.0:1783562475.120309:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:1.0:1783562475.120476:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563657600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783562475.120570:0:14171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562475.120608:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f000 going to sleep for 11 seconds 00000100:00100000:0.0:1783562475.120630:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563657600 00000100:00100000:0.0:1783562475.120636:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563657600 00000100:00100000:0.0:1783562475.120669:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562475.120682:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563657600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783562475.120750:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563657600:12345-0@lo:1000:mdt00_002.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562475.120757:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562475.120785:0:14171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:1.0:1783562475.120793:0:14171:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcef1eaa00, transno 8589934596 00000100:00100000:1.0:1783562475.120814:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563657600:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783562475.121343:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934667 00000100:00100000:1.0:1783562475.121393:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563657728:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783562475.121446:0:14171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562475.121511:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f900 going to sleep for 11 seconds 00000100:00100000:3.0:1783562475.121546:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563657728 00000100:00100000:3.0:1783562475.121551:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563657728 00000100:00100000:3.0:1783562475.121609:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562475.121618:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14171:x1870200563657728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783562475.121821:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14171:x1870200563657728:12345-0@lo:1000:mdt00_002.0 Request processed in 205us (375us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783562475.121829:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562475.121849:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14171:1870200563657728:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783562475.121878:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121889:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121909:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121915:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562475.121920:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121929:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121945:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcc4c37800) 00010000:00010000:1.0:1783562475.121948:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562475.121953:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121960:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498000/0x4738ba0933b897f4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.121995:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122003:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122008:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122013:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562475.122017:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122032:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122042:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562475.122045:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562475.122051:0:14171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 18 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122062:0:14171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 18 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122071:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 18 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.122097:0:14171:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 18 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562475.122108:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563657856:192.168.204.4@tcp:105: 00000100:00100000:1.0:1783562475.122211:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562475.124829:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562475.124962:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218688 00000100:00100000:0.0:1783562475.124973:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218688 00000100:00100000:0.0:1783562475.125052:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:0.0:1783562475.125062:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14628:x1870200553218688:12345-192.168.204.4@tcp:49:lfs.0 00000100:00100000:0.0:1783562475.125208:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14628:x1870200553218688:12345-192.168.204.4@tcp:49:lfs.0 Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562475.125215:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:3.0:1783562475.125305:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14171:1870200563657856:192.168.204.4@tcp:105: 00010000:00010000:3.0:1783562475.125346:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125358:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336c00/0x4738ba0933b8973e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125458:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125479:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125495:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125506:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125523:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125530:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125536:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562475.125540:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125547:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125562:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562475.125565:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562475.125569:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125574:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b897fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125587:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125593:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125598:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125603:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562475.125612:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125619:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125628:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562475.125631:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783562475.125635:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.125641:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498800/0x4738ba0933b897ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562475.126103:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562475.126111:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783562475.126118:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+18:14629:x1870200553218432:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 11527us (11852us total) trans 8589934668 rc 0/0 00000100:00100000:3.0:1783562475.126132:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00000020:00080000:3.0:1783562475.126139:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783562475.126172:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1783562475.126182:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783562475.132323:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562475.132389:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562475.132540:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553218944 00000100:00100000:3.0:1783562475.132556:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553218944 00000100:00100000:1.0:1783562475.132592:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553219200 00000100:00100000:1.0:1783562475.132600:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553219200 00000100:00100000:3.0:1783562475.132630:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:3.0:1783562475.132644:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14629:x1870200553218944:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783562475.132649:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:1.0:1783562475.132662:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+19:14628:x1870200553219200:12345-192.168.204.4@tcp:58:lfs.0 00000040:00080000:1.0:1783562475.133219:0:15489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:1.0:1783562475.133347:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14628:x1870200553219200:12345-192.168.204.4@tcp:58:lfs.0 Request processed in 686us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562475.133357:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00000004:00080000:3.0:1783562475.133618:0:14173:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783562475.133709:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934669 00010000:00010000:3.0:1783562475.133883:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.133900:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.133960:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.133974:0:14173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.133980:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.133984:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.134000:0:14173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562475.134040:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562475.134049:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.134058:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562475.134063:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.134072:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.134113:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14629:x1870200553218944:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 1471us (1808us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1783562475.134121:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000020:00080000:3.0:1783562475.134125:0:14173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783562475.134208:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bfcd19d2800) 00010000:00010000:1.0:1783562475.134212:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783562475.134219:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.134226:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89802 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562475.134312:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562475.134315:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562475.134316:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562475.153110:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562475.154225:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553219328 00000100:00100000:3.0:1783562475.154242:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553219328 00000100:00100000:3.0:1783562475.154494:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:3.0:1783562475.154510:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+20:14631:x1870200553219328:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562475.154549:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562475.154578:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89809 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217da expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.154665:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.154684:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.154698:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.154733:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155003:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155013:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155916:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155935:0:14170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155946:0:14170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.155993:0:14170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 21 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562475.156012:0:14170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 21 pid: 14169 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562475.156098:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563657984:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562475.156357:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd35cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562475.158184:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14170:1870200563657984:192.168.204.4@tcp:104: 00010000:00010000:3.0:1783562475.158223:0:14170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.158776:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562475.158905:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553219584 00000100:00100000:1.0:1783562475.158913:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553219584 00000100:00100000:1.0:1783562475.158975:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:1.0:1783562475.158987:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:13705:x1870200553219584:12345-192.168.204.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783562475.159261:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:13705:x1870200553219584:12345-192.168.204.4@tcp:35:ldlm_bl.0 Request processed in 276us (487us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1783562475.159271:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1783562475.161813:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562475.161945:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553219712 00000100:00100000:0.0:1783562475.161953:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553219712 00010000:00010000:0.0:1783562475.161990:0:14832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 23 pid: 14169 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.162029:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562475.162039:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:2364:x1870200553219712:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562475.162056:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562475.162065:0:14832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 23 pid: 14169 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162081:0:14832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 23 pid: 14169 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162126:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89730 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2179b expref: 23 pid: 14169 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162143:0:14832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562475.162158:0:14832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162169:0:14832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162177:0:14832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562475.162206:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562475.162238:0:14170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162262:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562475.162311:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783562475.162316:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562475.162340:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162354:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162365:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.162375:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:2364:x1870200553219712:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 336us (569us total) trans 0 rc 0/0 00010000:00010000:2.0:1783562475.162376:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562475.162385:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00010000:00010000:2.0:1783562475.162391:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162441:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d2600 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562475.162446:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162456:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162466:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:2.0:1783562475.162469:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562475.162474:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162491:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2600/0x4738ba0933b89810 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162514:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162523:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162529:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162534:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562475.162538:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162544:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162552:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bfcd19d2d00) 00010000:00010000:2.0:1783562475.162555:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562475.162558:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162564:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89817 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162606:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89809 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217da expref: 22 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162634:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217da expref: 21 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562475.162641:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562475.162643:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562475.162646:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:2.0:1783562475.162688:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14631:x1870200553219328:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 8183us (9590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562475.162696:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 107 00010000:00010000:3.0:1783562475.574606:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783562475.604093:0:16459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783562475.604109:0:16459:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562475.604253:0:16459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1783562475.604261:0:16459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1783562476.150682:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562476.150695:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562476.150741:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1783562476.150749:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783562476.150905:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf637d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563658112:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783562476.151045:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562476.156568:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562476.156758:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf637d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14203:1870200563658112:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562476.156958:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553219840 00000100:00100000:0.0:1783562476.156965:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553219840 00000100:00100000:0.0:1783562476.157026:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:0.0:1783562476.157034:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14643:x1870200553219840:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562476.157086:0:14169:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783562476.157211:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14643:x1870200553219840:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 175us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562476.157218:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:3.0:1783562476.160539:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562476.160704:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553220096 00000100:00100000:2.0:1783562476.160714:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553220096 00000100:00100000:2.0:1783562476.160773:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:2.0:1783562476.160783:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+21:14643:x1870200553220096:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562476.160802:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562476.160823:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b89825 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217e1 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.160927:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8982c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.160954:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8982c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.160968:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8982c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562476.160980:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783562476.161156:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336200/0x4738ba0933b89825 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e1 expref: 24 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.161175:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8982c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e1 expref: 23 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.161184:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562476.161186:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562476.161190:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337c00, rc 0) 00000100:00100000:2.0:1783562476.161261:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14643:x1870200553220096:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 478us (729us total) trans 8589934672 rc 0/0 00000100:00100000:2.0:1783562476.161268:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:2.0:1783562476.167541:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562476.167636:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553220224 00000100:00100000:1.0:1783562476.167647:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553220224 00000100:00100000:1.0:1783562476.167753:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:1.0:1783562476.167762:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:2361:x1870200553220224:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562476.167777:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562476.167800:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337c00/0x4738ba0933b8982c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e1 expref: 23 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562476.167816:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562476.167820:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562476.167877:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:2361:x1870200553220224:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562476.167888:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:0.0:1783562476.168290:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562476.168339:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553220480 00000100:00100000:2.0:1783562476.168504:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553220480 00000100:00100000:2.0:1783562476.168551:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:2.0:1783562476.168559:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+22:14643:x1870200553220480:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783562476.168626:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168638:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168671:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168893:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168902:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168908:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168914:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562476.168918:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168925:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168934:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:2.0:1783562476.168937:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562476.168941:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562476.168947:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6337800/0x4738ba0933b8983a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562476.169166:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14643:x1870200553220480:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 606us (876us total) trans 8589934673 rc 0/0 00000100:00100000:2.0:1783562476.169174:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 110 00000040:00080000:0.0:1783562476.169338:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783562476.169399:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783562476.169897:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:0.0:1783562476.169909:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783562476.172735:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562476.173096:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553220736 00000100:00100000:3.0:1783562476.173107:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553220736 00000100:00100000:3.0:1783562476.173452:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:3.0:1783562476.173480:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+23:14643:x1870200553220736:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783562476.173752:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:14643:x1870200553220736:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 289us (1027us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1783562476.173760:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00010000:00010000:1.0:1783562476.598636:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783562476.941094:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1783562476.941129:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000040:00080000:2.0:1783562477.055670:0:16512:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562477.055684:0:16512:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562477.055800:0:16512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1783562477.055806:0:16512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783562477.179889:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562477.179981:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553220992 00000100:00100000:3.0:1783562477.179995:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553220992 00000100:00100000:3.0:1783562477.180106:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:3.0:1783562477.180129:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+24:14663:x1870200553220992:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562477.180163:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562477.180196:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89841 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217e8 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562477.180342:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89848 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562477.180361:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89848 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562477.180376:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89848 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562477.180389:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783562477.180602:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3800/0x4738ba0933b89841 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e8 expref: 27 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562477.180623:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89848 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e8 expref: 26 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562477.180632:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:3.0:1783562477.180636:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783562477.180639:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3c00, rc 0) 00000100:00100000:3.0:1783562477.180700:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14663:x1870200553220992:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 575us (824us total) trans 8589934675 rc 0/0 00000100:00100000:3.0:1783562477.180708:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00080000:2.0:1783562477.180932:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562477.184156:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562477.184922:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221120 00000100:00100000:1.0:1783562477.184942:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221120 00000100:00100000:1.0:1783562477.185057:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:1.0:1783562477.185068:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14663:x1870200553221120:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:1.0:1783562477.185172:0:15489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185205:0:15489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185227:0:15489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185259:0:15489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185267:0:15489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185274:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185281:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562477.185286:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185294:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185306:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:1.0:1783562477.185309:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783562477.185314:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562477.185321:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89856 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562477.185434:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14663:x1870200553221120:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 368us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562477.185443:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:2.0:1783562477.261117:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562477.261281:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221248 00000100:00100000:0.0:1783562477.261296:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221248 00000100:00100000:0.0:1783562477.261389:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1783562477.261443:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2363:x1870200553221248:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:0.0:1783562477.261464:0:14804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562477.261493:0:14804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b8985d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c217ef expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562477.261530:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 13, mtime: 0x6a4f00e8, atime: 0x6a4f00e8, ctime: 0x6a4f00e8, blocks: 0xb 00010000:00010000:0.0:1783562477.261554:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=286s v=(0 0) 00010000:00010000:0.0:1783562477.261559:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562477.261569:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b8985d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217ef expref: 7 pid: 14804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562477.261589:0:14804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b8985d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217ef expref: 7 pid: 14804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562477.261603:0:14804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f600, rc 0) 00000100:00100000:0.0:1783562477.261680:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553221248:12345-192.168.204.4@tcp:101:cat.0 Request processed in 280us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562477.261688:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00080000:2.0:1783562477.261750:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562477.268555:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562477.268675:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221376 00000100:00100000:0.0:1783562477.268688:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221376 00002000:00100000:0.0:1783562477.268741:0:14811:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffff9bfceed9d180 x1870200553221376/t0(0) o3->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1783562488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783562477.268762:0:14811:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceed9d180 with x1870200553221376 ext(0->4095) 00002000:00010000:0.0:1783562477.268767:0:14811:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bfceed9d180 00000100:00100000:0.0:1783562477.268852:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:0.0:1783562477.268861:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553221376:12345-192.168.204.4@tcp:3:cat.0 00000100:00100000:0.0:1783562477.269147:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2364:x1870200553221376:12345-192.168.204.4@tcp:3:cat.0 Request processed in 285us (602us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783562477.269156:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00002000:00100000:0.0:1783562477.269163:0:14811:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffff9bfceed9d180 x1870200553221376/t0(0) o3->a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc@192.168.204.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1783562488 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783562477.269172:0:14811:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bfceed9d180 with x1870200553221376 ext(0->4095) 00002000:00010000:0.0:1783562477.269176:0:14811:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bfceed9d180 00010000:00010000:1.0:1783562477.622642:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562478.647442:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562478.968085:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563658240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562478.968186:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562478.970099:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658240 00000100:00100000:3.0:1783562478.970114:0:16419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658240 00000100:00100000:3.0:1783562478.970193:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562478.970206:0:16419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563658240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562478.970246:0:16419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562478.970337:0:16419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563658240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562478.970346:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562478.970444:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563658240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783562478.970835:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562479.478887:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563658496:0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.478907:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563658752:0@lo:400:kworker.0 00000100:00100000:2.0:1783562479.478983:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563658368:0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.479099:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562479.479162:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783562479.479169:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563658624:0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.479211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562479.479247:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658752 00000100:00100000:3.0:1783562479.479255:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658752 00000100:00100000:3.0:1783562479.479322:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658624 00000100:00100000:3.0:1783562479.479326:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658624 00000100:00100000:3.0:1783562479.479346:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562479.479356:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563658752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.479453:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1870200563658752:12345-0@lo:400:kworker.0 Request processed in 97us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562479.479461:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562479.479479:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783562479.479484:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563658624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.479512:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563658624:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562479.479518:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783562479.479560:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563658624:0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.479571:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3275:1870200563658752:0@lo:400:kworker.0 00000100:00080000:3.0:1783562479.479624:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562479.480734:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562479.480793:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563658880:0@lo:400:kworker.0 00000100:00100000:2.0:1783562479.480835:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562479.480860:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783562479.480868:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562479.480896:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562479.480952:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659008 00000100:00100000:2.0:1783562479.480961:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659008 00000100:00100000:2.0:1783562479.481017:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562479.481027:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563659008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562479.481077:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562479.481123:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563659008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562479.481130:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562479.481177:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:2.0:1783562479.481184:0:3272:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000004:00080000:2.0:1783562479.481210:0:3272:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcef1eb100, transno 8589934601 00000100:00100000:2.0:1783562479.481230:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562479.481317:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658368 00000100:00100000:3.0:1783562479.481322:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658368 00000100:00100000:3.0:1783562479.481360:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783562479.481369:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3272:x1870200563658368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.481434:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3272:x1870200563658368:12345-0@lo:400:kworker.0 Request processed in 66us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562479.481440:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1783562479.481841:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562479.481863:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658880 00000100:00100000:3.0:1783562479.481868:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658880 00000100:00100000:3.0:1783562479.481906:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783562479.481913:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563658880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.481960:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1870200563658880:12345-0@lo:400:kworker.0 Request processed in 47us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562479.481968:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783562479.481988:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562479.482009:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563658368:0@lo:400:kworker.0 00000100:00100000:3.0:1783562479.482022:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563658880:0@lo:400:kworker.0 00000100:00100000:1.0:1783562479.482150:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562479.482183:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563658496 00000100:00100000:1.0:1783562479.482187:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563658496 00000100:00100000:1.0:1783562479.482221:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562479.482228:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563658496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562479.482262:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1870200563658496:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562479.482268:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562479.482315:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563658496:0@lo:400:kworker.0 00010000:00010000:0.0:1783562479.671450:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562479.989849:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562479.990356:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221504 00000100:00100000:3.0:1783562479.990554:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221504 00000100:00100000:2.0:1783562479.990851:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:2.0:1783562479.990864:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14375:x1870200553221504:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783562479.990980:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14375:x1870200553221504:12345-192.168.204.4@tcp:60:lhsmtool_posix.0 Request processed in 119us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562479.990989:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00080000:3.0:1783562479.991113:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562479.993195:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562479.993273:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221760 00000100:00100000:0.0:1783562479.993284:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221760 00000100:00100000:0.0:1783562479.993343:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562479.993355:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+26:14375:x1870200553221760:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562479.993883:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+27:14375:x1870200553221760:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 527us (692us total) trans 8589934676 rc 0/0 00000100:00100000:0.0:1783562479.993890:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:0.0:1783562480.060865:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562480.061017:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553221888 00000100:00100000:2.0:1783562480.061029:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553221888 00000100:00100000:0.0:1783562480.061105:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562480.061153:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562480.061183:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562480.061211:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:0.0:1783562480.061218:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562480.061227:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2363:x1870200553221888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562480.061234:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222016 00000100:00100000:1.0:1783562480.061240:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222016 00000100:00100000:1.0:1783562480.061290:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222528 00000100:00100000:0.0:1783562480.061293:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562480.061295:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222528 00000100:00100000:2.0:1783562480.061301:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2363:x1870200553221888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562480.061308:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:1.0:1783562480.061320:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222144 00000100:00100000:1.0:1783562480.061324:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222144 00000100:00100000:1.0:1783562480.061346:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222400 00000100:00100000:1.0:1783562480.061349:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222400 00000100:00100000:3.0:1783562480.061364:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222272 00000100:00100000:3.0:1783562480.061369:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222272 00000100:00100000:1.0:1783562480.061374:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:1.0:1783562480.061384:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553222016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562480.061436:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1783562480.061446:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2364:x1870200553222272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562480.061458:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+7:2363:x1870200553222016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562480.061467:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562480.061475:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:1.0:1783562480.061486:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1783562480.061488:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553222528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562480.061500:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553222144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1783562480.061550:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2364:x1870200553222272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562480.061557:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:2.0:1783562480.061666:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553222528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 181us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562480.061673:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562480.061685:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562480.061690:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553222400:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562480.061710:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2364:x1870200553222400:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 20us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562480.061721:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00080000:2.0:1783562480.061735:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783562480.061739:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783562480.061741:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562480.063112:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2364:x1870200553222144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1607us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562480.063126:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000040:00080000:1.0:1783562480.246675:0:14203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783562480.246686:0:14203:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783562480.246724:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1783562480.246733:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:3.0:1783562480.538149:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1783562480.538174:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1783562480.541164:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934676 is committed 00000020:00080000:2.0:1783562480.541191:0:5776:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc801f000 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1783562480.541196:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc801fa80 00000020:00080000:2.0:1783562480.541200:0:5776:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef506000 00000020:00080000:2.0:1783562480.541228:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:0.0:1783562480.541292:0:14208:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:0.0:1783562480.541575:0:14208:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:1.0:1783562480.694594:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562481.690756:0:16711:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:01:19 (1783562479) 00010000:00010000:2.0:1783562481.720692:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562482.742820:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562483.600390:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562483.600579:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553222784 00000100:00100000:1.0:1783562483.600591:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553222784 00000100:00080000:2.0:1783562483.600664:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562483.600677:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:1.0:1783562483.600690:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+13:15335:x1870200553222784:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:1.0:1783562483.601319:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:15335:x1870200553222784:12345-192.168.204.4@tcp:35:umount.0 Request processed in 629us (936us total) trans 8589934677 rc 0/0 00000100:00100000:1.0:1783562483.601329:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:3.0:1783562483.603855:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562483.603926:0:16314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223040 00000100:00100000:0.0:1783562483.603937:0:16314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223040 00000100:00100000:0.0:1783562483.604003:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:0.0:1783562483.604012:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+14:15335:x1870200553223040:12345-192.168.204.4@tcp:35:umount.0 00000100:00100000:0.0:1783562483.604350:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:15335:x1870200553223040:12345-192.168.204.4@tcp:35:umount.0 Request processed in 338us (503us total) trans 8589934678 rc 0/0 00000100:00100000:0.0:1783562483.604359:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562483.606569:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562483.606612:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562483.606713:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223168 00000100:00100000:3.0:1783562483.606722:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223168 00000100:00100000:0.0:1783562483.606778:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223296 00000100:00100000:0.0:1783562483.606783:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223296 00000100:00100000:3.0:1783562483.606831:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562483.606855:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+14:2362:x1870200553223168:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562483.606869:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562483.606889:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3000/0x4738ba0933b890f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21587 expref: 14 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562483.606908:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562483.606975:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+13:2362:x1870200553223168:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 122us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562483.606984:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:0.0:1783562483.607011:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562483.607020:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:2361:x1870200553223296:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562483.607029:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562483.607040:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b890fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215b1 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.607051:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562483.607072:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:2361:x1870200553223296:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 54us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562483.607657:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562483.608192:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562483.608464:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562483.608668:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223552 00000100:00100000:1.0:1783562483.608676:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223552 00000100:00100000:1.0:1783562483.608733:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562483.608749:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:2361:x1870200553223552:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562483.608762:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562483.608779:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89236 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21652 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562483.608793:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562483.608860:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:2361:x1870200553223552:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 119us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562483.608883:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562483.609139:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223424 00000100:00100000:2.0:1783562483.609145:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223424 00000100:00100000:2.0:1783562483.609226:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1783562483.609235:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2360:x1870200553223424:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:2.0:1783562483.609263:0:14806:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89117 00000100:00080000:2.0:1783562483.609278:0:14806:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d1800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783562483.609315:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783562483.609318:0:14806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1783562483.609599:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+2:2360:x1870200553223424:12345-192.168.204.4@tcp:9:umount.0 Request processed in 364us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562483.609607:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00080000:3.0:1783562483.609971:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562483.612139:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562483.612298:0:15965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553223808 00000100:00100000:0.0:1783562483.612309:0:15965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553223808 00000100:00100000:0.0:1783562483.612399:0:15965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:0.0:1783562483.612446:0:15965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfbc9295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+6:2360:x1870200553223808:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:0.0:1783562483.612474:0:15965:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89110 00000100:00080000:3.0:1783562483.612476:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1783562483.612496:0:15965:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfbc95d0000: total 0 00000100:00080000:0.0:1783562483.612502:0:15965:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783562483.612551:0:15965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000020:00010000:3.0:1783562483.612634:0:15964:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfbc95d0000: total 0 00010000:00010000:3.0:1783562483.612679:0:15964:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfbc95d0000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783562483.612752:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086195a71/0x4738ba0933b8985d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217ef expref: 6 pid: 14804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562483.612795:0:15964:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfbc95d0000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783562483.612822:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562483.612825:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562483.612829:0:15965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfbc9295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+2:2360:x1870200553223808:12345-192.168.204.4@tcp:9:umount.0 Request processed in 385us (699us total) trans 0 rc 0/0 00010000:00010000:3.0:1783562483.612830:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562483.612838:0:15965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:0.0:1783562483.619304:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562483.619581:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553224576 00000100:00100000:1.0:1783562483.619592:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553224576 00000100:00100000:1.0:1783562483.619655:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:1.0:1783562483.619666:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+15:2360:x1870200553224576:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:1.0:1783562483.619705:0:15489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89109 00000020:00010000:1.0:1783562483.619723:0:15489:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfbc1cc8000: total 0 00000100:00080000:1.0:1783562483.619728:0:15489:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783562483.619794:0:15489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000020:00010000:0.0:1783562483.619915:0:14158:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfbc1cc8000: total 0 00010000:00010000:0.0:1783562483.619919:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562483.619979:0:14158:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfbc1cc8000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783562483.620028:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcc4c37700) 00010000:00010000:0.0:1783562483.620033:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562483.620041:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1de00/0x4738ba0933b8927c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21659 expref: 14 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620071:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562483.620074:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562483.620079:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d2c00/0x4738ba0933b8981e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217da expref: 13 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620092:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562483.620095:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783562483.620099:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc13d3c00/0x4738ba0933b89848 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217e8 expref: 12 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620135:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562483.620138:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783562483.620142:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89355 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21698 expref: 11 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620154:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bfcc4c37000) 00010000:00010000:0.0:1783562483.620156:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783562483.620160:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf698ee00/0x4738ba0933b895fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21755 expref: 10 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620175:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bfcc4c37100) 00010000:00010000:0.0:1783562483.620177:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783562483.620180:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6336800/0x4738ba0933b89745 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c217a2 expref: 9 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620196:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:0.0:1783562483.620198:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562483.620202:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1ce00/0x4738ba0933b892d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2166e expref: 8 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620213:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcc4c37c00) 00010000:00010000:0.0:1783562483.620215:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562483.620219:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1da00/0x4738ba0933b89298 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21660 expref: 7 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562483.620231:0:14158:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfbc1cc8000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1783562483.620245:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562483.620252:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562483.620254:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562483.620912:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc+5:2360:x1870200553224576:12345-192.168.204.4@tcp:39:umount.0 Request processed in 1244us (1615us total) trans 8589934679 rc 0/0 00000100:00100000:1.0:1783562483.620923:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 114 00010000:00010000:0.0:1783562483.766768:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562484.086645:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563659136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562484.086722:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562484.087089:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659136 00000100:00100000:3.0:1783562484.087098:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659136 00000100:00080000:2.0:1783562484.087154:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562484.087163:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783562484.087175:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563659136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783562484.087210:0:14808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562484.087276:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563659136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562484.087284:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562484.087317:0:3274:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1783562484.087324:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1783562484.087352:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563659136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783562484.556012:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562484.556115:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562484.556265:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562484.556373:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553224704 00000100:00100000:3.0:1783562484.556383:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553224704 00000100:00100000:0.0:1783562484.556384:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553224832 00000100:00100000:0.0:1783562484.556387:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553224832 00000100:00100000:3.0:1783562484.556472:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553224960 00000100:00100000:3.0:1783562484.556476:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553224960 00000100:00100000:2.0:1783562484.556512:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562484.556538:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225088 00000100:00100000:2.0:1783562484.556542:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225088 00000100:00100000:2.0:1783562484.556586:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:2.0:1783562484.556596:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2360:x1870200553225088:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:2.0:1783562484.556631:0:14806:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89213 00000100:00080000:2.0:1783562484.556641:0:14806:0:(import.c:65:import_set_state_nolock()) ffff9bfd00d41000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783562484.556678:0:14806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1783562484.556874:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+2:2360:x1870200553225088:12345-192.168.204.4@tcp:9:umount.0 Request processed in 278us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562484.556881:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00080000:2.0:1783562484.556902:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562484.558856:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562484.558876:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+12:2361:x1870200553224704:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783562484.558894:0:14832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562484.558917:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1d600/0x4738ba0933b891f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c215e9 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562484.558936:0:14832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562484.559000:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:2361:x1870200553224704:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 132us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562484.559031:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:1.0:1783562484.559043:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+11:2362:x1870200553224832:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562484.559051:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562484.559060:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698e400/0x4738ba0933b891f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21613 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562484.559070:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562484.559090:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+10:2362:x1870200553224832:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 51us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562484.559128:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:1.0:1783562484.559149:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562484.559155:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+9:2361:x1870200553224960:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562484.559163:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562484.559171:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1ca00/0x4738ba0933b8922f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2164b expref: 9 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562484.559179:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562484.559194:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf637ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+8:2361:x1870200553224960:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 39us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562484.559200:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00010000:00010000:3.0:1783562484.559340:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562484.559448:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:3.0:1783562484.565604:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562484.565790:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225216 00000100:00100000:1.0:1783562484.565800:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225216 00000100:00080000:2.0:1783562484.565867:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562484.565917:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:1.0:1783562484.565929:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+5:2360:x1870200553225216:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:1.0:1783562484.565980:0:14804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b8920c 00000100:00080000:1.0:1783562484.565991:0:14804:0:(import.c:65:import_set_state_nolock()) ffff9bfcd07c5800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783562484.566045:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783562484.566048:0:14804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1783562484.566275:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56505833-5a6d-4dcf-a09f-d3837b93b675+2:2360:x1870200553225216:12345-192.168.204.4@tcp:9:umount.0 Request processed in 347us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562484.566284:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:0.0:1783562484.572110:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562484.572235:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225472 00000100:00100000:3.0:1783562484.572246:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225472 00000100:00100000:3.0:1783562484.572330:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:3.0:1783562484.572341:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+6:2360:x1870200553225472:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:3.0:1783562484.572400:0:14171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89205 00000020:00010000:3.0:1783562484.572438:0:14171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcf7135800: total 0 00000100:00080000:3.0:1783562484.572443:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9bfcd345b800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783562484.572516:0:14157:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcf7135800: total 0 00000100:00080000:2.0:1783562484.572534:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783562484.572568:0:14157:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcf7135800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783562484.572607:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcc4c37500) 00010000:00010000:1.0:1783562484.572611:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562484.572633:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfceee1dc00/0x4738ba0933b892de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21675 expref: 5 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562484.572663:0:14157:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcf7135800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783562484.572676:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562484.572678:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562484.572680:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783562484.572707:0:14171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00100000:3.0:1783562484.572949:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56505833-5a6d-4dcf-a09f-d3837b93b675+3:2360:x1870200553225472:12345-192.168.204.4@tcp:39:umount.0 Request processed in 609us (848us total) trans 8589934680 rc 0/0 00000100:00100000:3.0:1783562484.572957:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:2.0:1783562484.589206:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562484.589299:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225728 00000100:00100000:3.0:1783562484.589311:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225728 00000100:00100000:3.0:1783562484.589371:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:3.0:1783562484.589381:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+7:2360:x1870200553225728:12345-192.168.204.4@tcp:251:umount.0 00000020:00000080:3.0:1783562484.589478:0:14163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b890e6 00000020:00010000:3.0:1783562484.589488:0:14163:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcf7130800: total 0 00000100:00080000:3.0:1783562484.589493:0:14163:0:(import.c:65:import_set_state_nolock()) ffff9bfcf7133000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783562484.589577:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:876f48e4-b384-4b8b-bbd5-8ded2a13ee69+3:2360:x1870200553225728:12345-192.168.204.4@tcp:251:umount.0 Request processed in 196us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562484.589603:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 119 00000020:00010000:0.0:1783562484.589743:0:15964:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcf7130800: total 0 00010000:00010000:0.0:1783562484.589790:0:15964:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcf7130800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783562484.589825:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b890ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21580 expref: 2 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562484.589840:0:15964:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcf7130800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783562484.589850:0:15964:0:(genops.c:906:class_export_put()) final put ffff9bfcf7130800/876f48e4-b384-4b8b-bbd5-8ded2a13ee69 00010000:00010000:0.0:1783562484.589867:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562484.589869:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562484.589871:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562484.590003:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7130800/876f48e4-b384-4b8b-bbd5-8ded2a13ee69 for MGS 00000020:00000080:3.0:1783562484.590040:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcf7133000 for MGS 00000100:00100000:3.0:1783562484.598655:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563659264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562484.598745:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562484.598804:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659264 00000100:00100000:1.0:1783562484.598816:0:16419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659264 00000100:00080000:2.0:1783562484.598982:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783562484.599033:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562484.599050:0:16419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563659264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783562484.599101:0:16419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562484.599154:0:16419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563659264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562484.599162:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562484.599554:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563659264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562484.599582:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563659776:0@lo:400:kworker.0 00000100:00100000:1.0:1783562484.599583:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563659520:0@lo:400:kworker.0 00000100:00100000:0.0:1783562484.599591:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563659648:0@lo:400:kworker.0 00000100:00100000:1.0:1783562484.599629:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562484.599651:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783562484.599657:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563659392:0@lo:400:kworker.0 00000100:00100000:1.0:1783562484.599686:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562484.599805:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562484.599845:0:15489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659520 00000100:00100000:2.0:1783562484.600008:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659392 00000100:00100000:2.0:1783562484.600013:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659392 00000100:00100000:2.0:1783562484.600063:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783562484.600072:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd9254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3273:x1870200563659392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562484.600114:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd9254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3273:x1870200563659392:12345-0@lo:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562484.600122:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783562484.600163:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659776 00000100:00100000:2.0:1783562484.600167:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659776 00000100:00100000:2.0:1783562484.600216:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783562484.600223:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563659776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562484.600274:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1870200563659776:12345-0@lo:400:kworker.0 Request processed in 52us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562484.600281:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1783562484.600301:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562484.600495:0:15489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659520 00000100:00100000:3.0:1783562484.600529:0:15489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783562484.600536:0:15489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563659520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562484.600570:0:15489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1870200563659520:12345-0@lo:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562484.600577:0:15489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783562484.600580:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563659392:0@lo:400:kworker.0 00000100:00100000:1.0:1783562484.600599:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3273:1870200563659520:0@lo:400:kworker.0 00000100:00100000:3.0:1783562484.600611:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563659776:0@lo:400:kworker.0 00000100:00100000:0.0:1783562484.600796:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562484.600829:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659648 00000100:00100000:2.0:1783562484.600834:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659648 00000100:00080000:0.0:1783562484.600862:0:14165:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562484.600878:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783562484.600885:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563659648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562484.600931:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563659648:12345-0@lo:400:kworker.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562484.600937:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783562484.601060:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563659648:0@lo:400:kworker.0 00010000:00010000:2.0:1783562484.790588:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783562485.504888:0:16906:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783562485.511574:0:16906:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783562485.511639:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.511655:0:16906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.511662:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.511687:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.511720:0:16906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783562485.511725:0:16906:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783562485.511751:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783562485.511756:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783562485.511762:0:16906:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783562485.511786:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ecf000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783562485.511800:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562485.511810:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.511819:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562485.511829:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.511838:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562485.511844:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562485.511850:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562485.511852:0:14157:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783562485.511855:0:14157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783562485.511879:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.511887:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783562485.511902:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563659904:0@lo:39:umount.0 00010000:00010000:1.0:1783562485.511924:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.511933:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682800/0x4738ba0933b88ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88ee0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.511946:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562485.511948:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562485.511959:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783562485.511965:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562485.511975:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562485.511985:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562485.512014:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562485.512061:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563659904 00000100:00100000:2.0:1783562485.512070:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563659904 00000100:00100000:1.0:1783562485.512078:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660032 00000100:00100000:1.0:1783562485.512084:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660032 00000100:00100000:1.0:1783562485.512131:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562485.512135:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783562485.512144:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3273:x1870200563660032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562485.512149:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1870200563659904:12345-0@lo:39:umount.0 00010000:00010000:1.0:1783562485.512159:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1783562485.512176:0:14171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88f7a 00010000:00010000:1.0:1783562485.512177:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6337200/0x4738ba0933b88ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88ed9 expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783562485.512185:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e30800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783562485.512202:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562485.512231:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562485.512250:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84b51d8-00f8-4fc5-9608-af3d9dda1905+18:3273:x1870200563660032:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562485.512257:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783562485.512277:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3271:x1870200563659904:12345-0@lo:39:umount.0 Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562485.512287:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000020:00000080:2.0:1783562485.512296:0:14171:0:(genops.c:906:class_export_put()) final put ffff9bfceed13000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1783562485.512301:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660032:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783562485.512323:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfceed13000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1783562485.512350:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc3ecf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1783562485.512395:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc7e30800 for lustre-MDT0000 00000100:00100000:3.0:1783562485.512510:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563659904:0@lo:39:umount.0 00000100:00080000:1.0:1783562485.512545:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783562485.512548:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783562485.512552:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783562485.513446:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513459:0:16906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513465:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513471:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513486:0:16906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562485.513491:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513496:0:16906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513501:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513515:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513535:0:16906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783562485.513541:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513546:0:16906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513552:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513559:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513571:0:16906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783562485.513576:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513582:0:16906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513589:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513594:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.513601:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562485.513610:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562485.513613:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562485.513615:0:16906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783562485.513618:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562485.513620:0:16906:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1783562485.513640:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683a00 already unused, calling callback (ffffffffc1a65c20) 00010000:00010000:2.0:1783562485.513641:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337a00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:3.0:1783562485.513648:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562485.513649:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783562485.513650:0:16906:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783562485.513657:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783562485.513664:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562485.513670:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:3.0:1783562485.513671:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.513674:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783562485.513679:0:16906:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bfcca2d8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1783562485.513698:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562485.513698:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783562485.513702:0:16906:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bfbc6a52800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1783562485.513708:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783562485.513713:0:14158:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00080000:1.0:1783562485.513715:0:16906:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9bfcf7135800 56505833-5a6d-4dcf-a09f-d3837b93b675 192.168.204.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 10000000:01000000:2.0:1783562485.513717:0:14158:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783562485.513731:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00080000:1.0:1783562485.513731:0:16906:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9bfbc1cc8000 a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 192.168.204.4@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934676 stale:0 10000000:01000000:3.0:1783562485.513737:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783562485.513742:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1783562485.513742:0:16906:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9bfcc3f1cd40) has exports, disconnecting them 00010000:00010000:2.0:1783562485.513743:0:14158:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783562485.513751:0:16906:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bfcca2d8000), last request at 1783562484 00010000:00010000:2.0:1783562485.513753:0:14158:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1783562485.513760:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b890ca 00010000:00010000:3.0:1783562485.513762:0:15964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.513770:0:15964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1783562485.513778:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfbc1cc9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783562485.513779:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.513789:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337a00/0x4738ba0933b88e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e46 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.513790:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.513806:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683a00/0x4738ba0933b890d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b890df expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.513810:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562485.513815:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783562485.513819:0:16906:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcca2d8000): rc 0 00010000:00010000:3.0:1783562485.513822:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562485.513823:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1d800 already unused, calling callback (ffffffffc1a65c20) 00000020:00000080:1.0:1783562485.513825:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcca2d8000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1783562485.513827:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562485.513829:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.513835:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337600 already unused, calling callback (ffffffffc1a65c20) 00000020:00080000:1.0:1783562485.513839:0:16906:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bfbc6a52800), last request at 1783562484 10000000:00010000:3.0:1783562485.513842:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783562485.513848:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88f8f 00010000:00010000:2.0:1783562485.513852:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.513858:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562485.513858:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfbc6a52000 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1783562485.513863:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783562485.513871:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcca2d8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 10000000:00010000:3.0:1783562485.513876:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562485.513880:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783562485.513886:0:14158:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783562485.513889:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783562485.513890:0:14158:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1783562485.513895:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783562485.513904:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:1.0:1783562485.513914:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc1cc9000 for lustre-MDT0000 00000020:00080000:1.0:1783562485.513924:0:16906:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfbc6a52800): rc 0 00000020:00000080:1.0:1783562485.513925:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfbc6a52800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1783562485.513976:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1783562485.513987:0:16906:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac9e01c63ae0 00010000:00010000:2.0:1783562485.513989:0:14158:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.513998:0:14158:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562485.514001:0:15964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783562485.514001:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6a52800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1783562485.514003:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563660288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562485.514007:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.514019:0:15964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562485.514023:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfceee1d800/0x4738ba0933b89259 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b89260 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.514032:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.514036:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783562485.514039:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc6a52000 for lustre-MDT0000 00010000:00010000:2.0:1783562485.514040:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562485.514044:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337600/0x4738ba0933b88e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88e38 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562485.514044:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562485.514061:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562485.514061:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562485.514061:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783562485.514062:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:3.0:1783562485.514067:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562485.514068:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00010000:00010000:3.0:1783562485.514071:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783562485.514082:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783562485.514086:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563660416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562485.514103:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562485.514124:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660288 00000100:00100000:0.0:1783562485.514130:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660288 00000100:00100000:2.0:1783562485.514133:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783562485.514138:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562485.514143:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660544:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783562485.514150:0:16906:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783562485.514163:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfcc6403000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783562485.514168:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660160 00000100:00100000:0.0:1783562485.514171:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660160 00000100:00080000:1.0:1783562485.514176:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783562485.514181:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562485.514181:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000100:00100000:0.0:1783562485.514192:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660416 00000004:00080000:1.0:1783562485.514193:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783562485.514195:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660416 00000100:00100000:3.0:1783562485.514197:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660544 00000100:00100000:3.0:1783562485.514203:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660544 00000100:00100000:0.0:1783562485.514216:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783562485.514227:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+21:3274:x1870200563660288:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562485.514233:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783562485.514239:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783562485.514244:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+21:3273:x1870200563660160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562485.514254:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562485.514255:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1d000/0x4738ba0933b890df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b890d8 expref: 21 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.514266:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6682400/0x4738ba0933b88e46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88e3f expref: 21 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562485.514272:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562485.514278:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562485.514328:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3273:x1870200563660160:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562485.514335:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+19:3274:x1870200563660288:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562485.514339:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783562485.514347:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783562485.514365:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562485.514371:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783562485.514375:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:3275:x1870200563660416:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562485.514383:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef5f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+17:3273:x1870200563660544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562485.514385:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562485.514396:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89260 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b89259 expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.514400:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562485.514442:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6682c00/0x4738ba0933b88e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88e31 expref: 16 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562485.514442:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562485.514461:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562485.514480:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:3275:x1870200563660416:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562485.514488:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562485.514493:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef5f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84b51d8-00f8-4fc5-9608-af3d9dda1905+15:3273:x1870200563660544:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562485.514501:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783562485.514529:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3275:1870200563660416:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783562485.514561:0:16906:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783562485.514571:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783562485.514599:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bfcc3f1cd40) has no exports 00000100:00100000:2.0:1783562485.514607:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3274:1870200563660288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562485.514692:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562485.514700:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3273:1870200563660160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562485.514716:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563660672:0@lo:9:umount.0 00000100:00100000:0.0:1783562485.514743:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562485.514793:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563660800:0@lo:9:umount.0 00000100:00100000:0.0:1783562485.514813:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562485.514912:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660672 00000100:00100000:1.0:1783562485.514912:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563660800 00000100:00100000:2.0:1783562485.514917:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660672 00000100:00100000:1.0:1783562485.514917:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563660800 00000100:00100000:1.0:1783562485.514961:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783562485.514969:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1870200563660800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783562485.514987:0:14803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b8912c 00000100:00100000:2.0:1783562485.514994:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1783562485.514994:0:14803:0:(import.c:65:import_set_state_nolock()) ffff9bfbc1cc8800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783562485.515000:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1870200563660672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783562485.515012:0:14806:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88fab 00000001:00000004:1.0:1783562485.515019:0:14803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00080000:2.0:1783562485.515021:0:14806:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e36000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783562485.515039:0:14806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1783562485.515170:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3271:x1870200563660672:12345-0@lo:9:umount.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562485.515170:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3271:x1870200563660800:12345-0@lo:9:umount.0 Request processed in 202us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562485.515177:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783562485.515179:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1783562485.515212:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783562485.515230:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcc6403000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783562485.515239:0:3271:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783562485.515241:0:3271:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783562485.515244:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563660672:0@lo:9:umount.0 00000100:00080000:0.0:1783562485.515254:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d32800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783562485.515259:0:3271:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783562485.515260:0:3271:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783562485.515262:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563660800:0@lo:9:umount.0 00010000:00010000:0.0:1783562485.515299:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783562485.650263:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000020:00000080:0.0:1783562485.650272:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfbc95d0000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000001:00100000:0.0:1783562485.650298:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000020:00000080:0.0:1783562485.650301:0:6574:0:(genops.c:906:class_export_put()) final put ffff9bfcd07c7800/56505833-5a6d-4dcf-a09f-d3837b93b675 00000001:00100000:3.0:1783562485.650313:0:15962:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783562485.650319:0:15962:0:(genops.c:906:class_export_put()) final put ffff9bfcc7e30000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783562485.650325:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc95d0000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc for lustre-OST0000 00000020:00000080:0.0:1783562485.650374:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd07c7800/56505833-5a6d-4dcf-a09f-d3837b93b675 for lustre-OST0000 00000020:00000080:0.0:1783562485.650424:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc7e30000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783562485.650443:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc95d5000 for lustre-OST0000 00000020:00000080:0.0:1783562485.650448:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcd07c5800 for lustre-OST0000 00000020:00000080:0.0:1783562485.650452:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc7e36000 for lustre-OST0000 00000001:00080000:3.0:1783562485.651724:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00080000:3.0:1783562485.651738:0:5776:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000001:00100000:3.0:1783562485.651759:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000001:00080000:3.0:1783562485.651765:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:3.0:1783562485.651770:0:5776:0:(genops.c:906:class_export_put()) final put ffff9bfbc1cc8000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000001:00100000:3.0:1783562485.651788:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000001:00080000:3.0:1783562485.651794:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934680 is committed 00000020:00000080:3.0:1783562485.651796:0:5776:0:(genops.c:906:class_export_put()) final put ffff9bfcf7135800/56505833-5a6d-4dcf-a09f-d3837b93b675 00000020:00000080:1.0:1783562485.651803:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc1cc8000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc for lustre-MDT0000 00000020:00000080:1.0:1783562485.651858:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf7135800/56505833-5a6d-4dcf-a09f-d3837b93b675 for lustre-MDT0000 00000020:00000080:1.0:1783562485.651884:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc95d4800 for lustre-MDT0000 00000020:00000080:1.0:1783562485.651890:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcd345b800 for lustre-MDT0000 00000020:00080000:0.0:1783562485.651926:0:14208:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bfcc801f000 refcount 1 committed 1 result 0 batchid 4294967528 00000020:00080000:0.0:1783562485.651931:0:14208:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcc801fa80 00000020:00080000:0.0:1783562485.651935:0:14208:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bfcef2a0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bfcef506000 00000020:00080000:3.0:1783562485.660710:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bfcc3f1cd40) has no exports 00000020:00000080:3.0:1783562485.694324:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e8c 00000020:00000080:3.0:1783562485.694346:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcf6fbb000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783562485.694377:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783562485.694527:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.694540:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783562485.694546:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9bfcc50419c0) has no exports 00000020:00000080:0.0:1783562485.694750:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6fbb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783562485.696334:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e85 00000020:00000080:2.0:1783562485.696344:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfccffd5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783562485.696398:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfccffd5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783562485.696431:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.696443:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783562485.696447:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfccffd4800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783562485.696450:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfccffd4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783562485.696462:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783562485.696609:0:16906:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcf651aa80 - data ffff9bfcd8b12438/ffff9bfbc95cd400 00000020:01000000:2.0:1783562485.696744:0:16906:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfceee7c5a0 - data ffff9bfcd8acf000/ffff9bfbc92a5000 00000001:00000004:2.0:1783562485.710265:0:16906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934680 00000100:00080000:0.0:1783562485.750272:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783562485.750281:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1783562485.750305:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783562485.750308:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783562485.750817:0:14191:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783562485.750823:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1783562485.750833:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1783562485.751824:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783562485.751830:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:0.0:1783562485.751853:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783562485.751855:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783562485.752106:0:14193:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783562485.752111:0:14193:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 1 00000040:00080000:3.0:1783562485.752119:0:14193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1783562485.787590:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e54 00000020:00000080:2.0:1783562485.787606:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc6404000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783562485.787675:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc6404000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783562485.788337:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e69 00000020:00000080:2.0:1783562485.788343:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3f27000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783562485.788360:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783562485.788365:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.788381:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783562485.788385:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9bfcc3f1b380) has no exports 00000020:00000080:0.0:1783562485.788431:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3f27000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1783562485.788563:0:16906:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783562485.788571:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88eb6 00000020:00000080:2.0:1783562485.788575:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcd213d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783562485.788589:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783562485.788593:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.788597:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783562485.788599:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9bfcef64b380) has no exports 00000020:00000080:2.0:1783562485.788604:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88eaf 00000020:00000080:2.0:1783562485.788607:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcd0d37800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783562485.788664:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd213d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783562485.788672:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd0d37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783562485.789247:0:16906:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783562485.789252:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783562485.789257:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:2.0:1783562485.789263:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783562485.789265:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783562485.789296:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.789302:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783562485.789305:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcd0d32800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783562485.789307:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88ea1 00000020:00000080:0.0:1783562485.789310:0:8:0:(genops.c:906:class_export_put()) final put ffff9bfcf6fbd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562485.789312:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcf6fba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783562485.789313:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6fbd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783562485.789318:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783562485.789319:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783562485.789322:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.789325:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783562485.789327:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9bfcef64cd40) has no exports 00000020:00000080:2.0:1783562485.789330:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e9a 00000020:00000080:2.0:1783562485.789333:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc6402000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783562485.789390:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6fba800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783562485.789396:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc6402000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783562485.789688:0:16906:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783562485.789692:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783562485.789694:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1783562485.789698:0:16906:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783562485.789699:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562485.789727:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc6403000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783562485.789732:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.789741:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783562485.789744:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3f27800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562485.789746:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3f27800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783562485.789750:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783562485.789844:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.789847:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783562485.789849:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc6400800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783562485.789851:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc6400800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783562485.789854:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783562485.789933:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e70 00000020:00000080:2.0:1783562485.789938:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3f22000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783562485.789960:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783562485.789963:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.789967:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783562485.789970:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9bfcc5043380) has no exports 00000020:00000080:3.0:1783562485.789978:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3f22000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783562485.789989:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.789993:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783562485.789996:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc6406800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783562485.789998:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc6406800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783562485.790003:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783562485.790126:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e77 00000020:00000080:2.0:1783562485.790130:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3f23000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783562485.790139:0:16906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6881000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783562485.790143:0:16906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6881000 3 00000020:00000080:3.0:1783562485.790146:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3f23000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1783562485.790147:0:16906:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcf6881000 from lustre-MDT0000 00000020:00000080:2.0:1783562485.790170:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.790173:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783562485.790176:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc6404800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783562485.790178:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc6404800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783562485.790184:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783562485.790204:0:16906:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1783562485.790212:0:16906:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783562485.790214:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783562485.790216:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.790218:0:16906:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783562485.790224:0:16906:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9bfcd9277000 e84b51d8-00f8-4fc5-9608-af3d9dda1905 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783562485.790229:0:16906:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9bfcc3f18000) has exports, disconnecting them 00000020:00080000:2.0:1783562485.790233:0:16906:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bfcd9277000), last request at 1783562447 00000020:00000080:2.0:1783562485.790245:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e1c 00000020:00010000:2.0:1783562485.790248:0:16906:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bfcd9277000: total 0 00000100:00080000:2.0:1783562485.790252:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7fb4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783562485.790269:0:16906:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcd9277000): rc 0 00000020:00080000:2.0:1783562485.790273:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9bfcc3f18000) has no exports 00000100:00100000:1.0:1783562485.790345:0:14163:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bfd00e1dc00:14163] 1 exiting: rc = 0 00000100:00100000:2.0:1783562485.790365:0:14164:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bfd00e1d400:14164] 2 exiting: rc = 0 00000100:00100000:0.0:1783562485.790420:0:14161:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bfcd0f9ba00:14161] 0 exiting: rc = 1 00000020:00010000:3.0:1783562485.790428:0:15964:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bfcd9277000: total 0 00010000:00010000:3.0:1783562485.790433:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562485.790463:0:15964:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bfcd9277000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1783562485.790487:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1cc00/0x4738ba0933b89252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b8924b expref: 9 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790508:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6682e00/0x4738ba0933b890b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b890ae expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790517:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfceee1c000/0x4738ba0933b89244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b8923d expref: 7 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790529:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b88f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88f6c expref: 6 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790537:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2400/0x4738ba0933b8908b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b89084 expref: 5 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790547:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b88f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88f42 expref: 4 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790592:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b88e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88e23 expref: 3 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790604:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc5cb8600/0x4738ba0933b88f3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4738ba0933b88f34 expref: 2 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562485.790622:0:15964:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bfcd9277000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1783562485.790633:0:15964:0:(genops.c:906:class_export_put()) final put ffff9bfcd9277000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 00010000:00010000:3.0:1783562485.790644:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562485.790646:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562485.790647:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783562485.790652:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcd9277000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 for MGS 00000020:00000080:3.0:1783562485.790670:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc7fb4800 for MGS 00000100:00100000:2.0:1783562485.790738:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790747:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790752:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790758:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790763:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790769:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790775:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790780:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790785:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790791:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790796:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790800:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790806:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790811:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790816:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790821:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790827:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790832:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790837:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790842:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790852:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790858:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790864:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790869:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790875:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790881:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790892:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790899:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790904:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790909:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790914:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790918:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790924:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790929:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790936:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790941:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790977:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790984:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790989:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790994:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.790999:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791004:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791009:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791014:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791019:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791023:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791028:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791033:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791037:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791042:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791047:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791052:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791057:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791062:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791067:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791079:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791084:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791090:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791095:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791100:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791105:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791111:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791115:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562485.791120:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1783562485.791558:0:16906:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783562485.791562:0:16906:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1783562485.792226:0:16906:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd00b5f60 - data ffff9bfce77bcbd0/ffff9bfbc8f8d800 00000020:01000000:2.0:1783562485.792339:0:16906:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcd9474120 - data ffff9bfce60826c0/ffff9bfcf6f0bc00 00000020:00000080:2.0:1783562485.792832:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e00 00000020:00000080:2.0:1783562485.792839:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3e03000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783562485.792848:0:16906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6881000 from MGS, refs=2 00000020:01000004:2.0:1783562485.792850:0:16906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6881000 2 00000020:01000004:2.0:1783562485.792853:0:16906:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcf6881000 from MGS 00000020:00000080:2.0:1783562485.792872:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562485.792878:0:16906:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783562485.792880:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcf6886800/MGS 00000020:00000080:2.0:1783562485.792882:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6886800/MGS for MGS 00000020:01000000:2.0:1783562485.792887:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783562485.792936:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783562485.792939:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562485.792943:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:3.0:1783562485.792975:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3e03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1783562485.793003:0:16906:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bfcc3ece800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783562485.793008:0:16906:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9bfcf6b93380) has exports, disconnecting them 00000020:00080000:2.0:1783562485.793013:0:16906:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bfcc3ece800), last request at 1783562448 00000020:00000080:2.0:1783562485.793017:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88eee 00000020:00080000:2.0:1783562485.793025:0:16906:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfcc3ece800): rc 0 00000020:00000080:2.0:1783562485.793029:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3ece800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783562485.793748:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3ece800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783562485.794453:0:16906:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783562485.794458:0:16906:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783562485.794462:0:16906:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783562485.794468:0:16906:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562485.794487:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcc3ecf000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783562485.794593:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562485.794599:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783562485.794606:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcc3ec8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783562485.794611:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc3ec8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783562485.794615:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783562485.794665:0:16906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6881000 1 00000020:00000080:3.0:1783562485.794669:0:16906:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88df2 00000020:00000080:3.0:1783562485.794674:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcf6884800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783562485.794682:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783562485.794689:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6884800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783562485.794697:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562485.794701:0:16906:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783562485.794705:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9bfcc3f199c0) has no exports 00000020:00000080:3.0:1783562485.804980:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562485.805002:0:16906:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783562485.805007:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcf6880800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783562485.805012:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6880800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783562485.805019:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783562485.805191:0:16906:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfcf6882000 00000020:01000000:3.0:1783562485.805210:0:16906:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783562485.805214:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783562485.805218:0:16906:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783562485.805231:0:16906:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9bfcf6b94d40) has no exports 00000100:00100000:0.0:1783562485.805492:0:14169:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bfcd8110000:14169] 0 exiting: rc = 1 00000100:00100000:3.0:1783562485.805689:0:15489:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bfbc1cc0a00:15489] 3 exiting: rc = 0 00000100:00100000:3.0:1783562485.805763:0:14170:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bfcd8111200:14170] 1 exiting: rc = 0 00000100:00100000:3.0:1783562485.808514:0:14171:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bfcd0f9a200:14171] 2 exiting: rc = 0 00000100:00100000:0.0:1783562485.808612:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808628:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808640:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808651:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808661:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808672:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808682:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808692:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808702:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808712:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808723:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808733:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808743:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808753:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808764:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808777:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808791:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808802:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808815:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808826:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808836:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808848:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808858:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808869:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808880:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808892:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808904:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808915:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808927:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808939:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808959:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808969:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.808995:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809056:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809073:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809085:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809096:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809108:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809119:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809130:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809149:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809161:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809172:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809183:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809194:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809206:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809215:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809224:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809232:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809240:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809248:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809256:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809264:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809272:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809282:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809292:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809302:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809309:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809320:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809327:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809333:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809339:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809345:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.809352:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562485.814562:0:14172:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bfceef30400:14172] 0 exiting: rc = 1 00000100:00100000:3.0:1783562485.814668:0:14173:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bfcd00c5600:14173] 1 exiting: rc = 0 00010000:00010000:1.0:1783562485.814836:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562485.814958:0:16314:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9bfcd812c400:16314] 2 exiting: rc = 0 00000100:00100000:1.0:1783562485.815023:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815033:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815038:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815046:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815052:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815058:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815063:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815068:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815073:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815079:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815084:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815089:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815094:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815099:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815104:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815109:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815114:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815118:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815124:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815129:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815134:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815140:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815145:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815150:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815155:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815161:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815166:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815171:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815176:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815181:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815186:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815190:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815195:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815207:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815214:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815235:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815239:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815244:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815249:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815254:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815259:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815264:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815269:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815274:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815279:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815284:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815289:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815293:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815298:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815303:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815308:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815313:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815317:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815322:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815326:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815331:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815336:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815342:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815347:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815353:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815358:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815364:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815370:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.815375:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562485.816216:0:14175:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bfcd00c4800:14175] 1 exiting: rc = 0 00000100:00100000:1.0:1783562485.816216:0:14174:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bfcd00c5e00:14174] 0 exiting: rc = 1 00000100:00100000:0.0:1783562485.817200:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817210:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817233:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817240:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817246:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817252:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817258:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817278:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817292:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817300:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817306:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817314:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817321:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817327:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817334:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817340:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817347:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817355:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817364:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817417:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817429:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817438:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817446:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817452:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817458:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817466:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817474:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817481:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817487:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817493:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817499:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817518:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817525:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817531:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817536:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817542:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817549:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817562:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817568:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817574:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817580:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817586:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817592:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817610:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817617:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817624:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817631:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817637:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817658:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817665:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817672:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817678:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817686:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817694:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817700:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817720:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817727:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817733:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817739:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817746:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817753:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817759:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817765:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.817782:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562485.824805:0:14176:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bfcd00c4400:14176] 0 exiting: rc = 1 00000100:00100000:1.0:1783562485.824865:0:14177:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bfcc3e5b000:14177] 1 exiting: rc = 0 00000100:00100000:0.0:1783562485.824956:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.824965:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.824970:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.824975:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825042:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825049:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825055:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825060:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825076:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825081:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825086:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825091:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825096:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825101:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825106:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825110:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825115:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825120:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825125:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825130:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825135:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825140:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825145:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825151:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825156:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825161:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825166:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825173:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825178:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825183:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825188:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825193:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825198:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825203:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825209:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825214:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825220:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825226:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825231:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825236:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825241:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825246:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825251:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825264:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825269:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825275:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825280:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825285:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825290:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825295:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825300:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825305:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825310:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825315:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825321:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825325:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825330:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825335:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825340:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825345:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825351:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825356:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825361:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.825365:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562485.825877:0:14178:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bfcc3e5a200:14178] 0 exiting: rc = 1 00000100:00100000:2.0:1783562485.826044:0:14179:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bfbc6980e00:14179] 1 exiting: rc = 0 00000100:00100000:0.0:1783562485.826110:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826117:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826123:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826128:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826133:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826139:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826144:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826149:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826154:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826160:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826164:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826169:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826175:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826180:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826195:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826200:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826206:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826211:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826216:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826221:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826225:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826230:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826234:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826239:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826244:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826250:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826255:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826260:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826264:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826269:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826275:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826279:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826285:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826290:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826297:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826303:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826308:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826313:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826319:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826324:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826328:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826334:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826339:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826344:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826349:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826355:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826360:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826364:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826370:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826383:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826388:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826394:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826399:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826537:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826542:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826547:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826552:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826557:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826562:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826567:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826573:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826577:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826583:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.826588:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783562485.826875:0:14180:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bfcc7a14400:14180] 0 exiting: rc = 1 00000100:00100000:2.0:1783562485.827357:0:14181:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bfbc6981e00:14181] 1 exiting: rc = 0 00000100:00100000:0.0:1783562485.827518:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827524:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827529:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827534:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827539:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827544:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827548:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827553:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827558:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827563:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827570:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827576:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827585:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827593:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827600:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827608:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827618:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827627:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827638:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827648:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827665:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827671:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827681:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827686:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827692:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827818:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827824:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827830:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827835:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827841:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827846:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827851:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827856:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827861:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827866:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827871:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827876:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827882:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827887:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827892:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827898:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827903:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827908:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827913:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827918:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827924:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827930:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827942:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827968:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827973:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827978:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827993:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.827998:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828003:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828010:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828018:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828022:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828028:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828031:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828035:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828040:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828043:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828047:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828051:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562485.828505:0:14184:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bfbc6981400:14184] 2 exiting: rc = 0 00000100:00100000:2.0:1783562485.828747:0:14182:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bfcc78b1a00:14182] 0 exiting: rc = 1 00000100:00100000:3.0:1783562485.828780:0:14183:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bfcc78b0000:14183] 1 exiting: rc = 0 00000100:00100000:0.0:1783562485.828829:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828836:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828842:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828847:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828853:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828858:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828863:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828869:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828874:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828880:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828885:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828891:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828896:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828902:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828908:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828913:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828919:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828925:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828930:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828936:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828941:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828963:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828969:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.828998:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829005:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829011:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829023:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829029:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829035:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829041:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829046:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829052:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829057:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829063:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829068:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829073:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829078:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829084:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829089:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829094:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829099:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829104:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829110:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829115:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829121:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829127:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829133:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829152:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829158:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829169:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829174:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829179:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829185:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829190:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829195:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829201:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829207:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829213:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829228:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829236:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829242:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829256:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829262:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562485.829268:0:16906:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783562485.832694:0:16906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562485.832711:0:16906:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783562485.832717:0:16906:0:(genops.c:906:class_export_put()) final put ffff9bfcef1dd000/MDS_uuid 00000020:00000080:0.0:1783562485.832723:0:16906:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef1dd000/MDS_uuid for MDS 00000020:01000000:0.0:1783562485.832729:0:16906:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783562485.832866:0:16906:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783562486.839195:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783562487.191573:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783562487.191585:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfbc1ccd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783562487.191621:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 56505833-5a6d-4dcf-a09f-d3837b93b675 00000020:00000080:1.0:1783562487.191623:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfce882e000/56505833-5a6d-4dcf-a09f-d3837b93b675 00000001:00100000:1.0:1783562487.191630:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000020:00000080:1.0:1783562487.191632:0:7460:0:(genops.c:906:class_export_put()) final put ffff9bfbc95d1000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc 00000020:00000080:3.0:1783562487.191981:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc1ccd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783562487.192066:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfce882e000/56505833-5a6d-4dcf-a09f-d3837b93b675 for lustre-OST0001 00000020:00000080:3.0:1783562487.192092:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc95d1000/a2fab9a9-c864-4ffc-8aa1-d20205ff1dcc for lustre-OST0001 00000020:00000080:3.0:1783562487.192138:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc1cc8800 for lustre-OST0001 00000020:00000080:3.0:1783562487.192143:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfd00d41000 for lustre-OST0001 00000020:00000080:3.0:1783562487.192148:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc95d1800 for lustre-OST0001 00000020:01000004:0.0:1783562487.199797:0:17059:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783562487.206558:0:17059:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783562487.206613:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562487.206628:0:17059:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562487.206635:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562487.206641:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562487.206661:0:17059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783562487.206666:0:17059:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783562487.206694:0:17059:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783562487.206700:0:17059:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783562487.206707:0:17059:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1783562487.206732:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1783562487.206735:0:17059:0:(import.c:65:import_set_state_nolock()) ffff9bfd00d43000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783562487.206752:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562487.206766:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfceee1c200 already unused, calling callback (ffffffffc1a65c20) 00000100:00100000:0.0:1783562487.206773:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563660928:0@lo:39:umount.0 10000000:00010000:3.0:1783562487.206794:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562487.206809:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783562487.206819:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1783562487.206829:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563660928 offset 0 length 224: 4 10000000:01000000:3.0:1783562487.206830:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783562487.206838:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783562487.206842:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783562487.206894:0:15964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562487.206905:0:15964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783562487.206961:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562487.206969:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfceee1c200/0x4738ba0933b88f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4738ba0933b88f73 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562487.206983:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562487.206985:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562487.206987:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562487.207208:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783562487.207224:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563661056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562487.207266:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562487.207331:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563661056 00000100:00100000:2.0:1783562487.207343:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563661056 00000100:00100000:2.0:1783562487.207396:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783562487.207430:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3272:x1870200563661056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783562487.207450:0:14156:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783562487 with bad export cookie 5132056324073885212 00000100:00100000:2.0:1783562487.213789:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3272:x1870200563661056:12345-0@lo:103:ldlm_bl.0 Request processed in 6350us (6510us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783562487.213810:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783562487.213961:0:3272:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783562487.213968:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783562487.213972:0:3272:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783562487.218074:0:3272:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783562487.218080:0:3272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783562487.218090:0:3272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfcef9ad180 x1870200563661056/t0(0) o103->MGC192.168.204.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783562503 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783562487.218108:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783562487.218110:0:3272:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783562487.218112:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783562487.218115:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562487.218120:0:3272:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 257 00000100:00080000:1.0:1783562487.218130:0:3272:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcef1db800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562487.218165:0:3272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2d880 x1870200563661184/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783562487.218199:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3272:1870200563661056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562487.218304:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563661184:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1783562487.218516:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870200563661184 offset 0 length 520: 4 00010000:00010000:1.0:1783562487.863132:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562488.887043:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783562489.719120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783562489.719135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783562489.719935:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563661312:0@lo:400:kworker.0 00000400:00000100:2.0:1783562489.720001:0:3274:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563661312 offset 0 length 224: 4 00010000:00010000:3.0:1783562489.911170:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562490.934633:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562491.958688:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783562492.726739:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783562492.726749:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783562492.726868:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563661440:0@lo:400:kworker.0 00000400:00000100:0.0:1783562492.726929:0:3275:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563661440 offset 0 length 224: 4 00010000:00010000:3.0:1783562492.982567:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562494.006843:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562495.030669:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562496.054580:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562497.079003:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562497.398570:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562487/real 1783562487] req@ffff9bfceee2d880 x1870200563661184/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783562497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562497.398608:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfceee2d880 x1870200563661184/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783562497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562497.398620:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562487/real 1783562487] req@ffff9bfcefb89880 x1870200563660928/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562497.398632:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcefb89880 x1870200563660928/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783562497.398655:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562497.398683:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783562497.398688:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563661184:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1783562497.398694:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfd00d43000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783562497.398722:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563660928:0@lo:39:umount.0 00000100:00080000:2.0:1783562497.398966:0:17059:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562497.398972:0:17059:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783562497.398977:0:17059:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783562497.399798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783562497.399806:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783562497.399811:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562497.399818:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 296 00000100:00080000:1.0:1783562497.399824:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783562497.399832:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcef1db800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562497.399878:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2c380 x1870200563661568/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783562497.399939:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563661696:0@lo:400:kworker.0 00000400:00000100:1.0:1783562497.399992:0:3272:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563661696 offset 0 length 224: 4 00010000:00010000:2.0:1783562497.400665:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400681:0:17059:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400690:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400733:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400752:0:17059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562497.400760:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400767:0:17059:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400775:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562497.400782:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562497.400790:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563661568:0@lo:250:kworker.0 00000400:00000100:0.0:1783562497.400826:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870200563661568 offset 0 length 520: 4 00010000:00010000:2.0:1783562497.400921:0:17059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783562497.400926:0:17059:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1783562497.401012:0:17059:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1783562497.401017:0:17059:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783562497.401022:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562497.401027:0:17059:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783562497.401032:0:17059:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9bfcf6b919c0) has no exports 00000020:00080000:2.0:1783562497.401059:0:17059:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9bfcf6b919c0) has no exports 00010000:00010000:0.0:1783562497.401093:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562497.401102:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401134:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562497.401139:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401149:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562497.401156:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562497.401161:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783562497.401164:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783562497.401166:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783562497.401179:0:15964:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:0.0:1783562497.401183:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401189:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337400/0x4738ba0933b88f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88f49 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401246:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562497.401251:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401256:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562497.401260:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401266:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562497.401280:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1783562497.401280:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562497.401289:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783562497.401291:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783562497.401294:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783562497.401302:0:15964:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:0.0:1783562497.401305:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401322:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683200/0x4738ba0933b8924b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b89252 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562497.401333:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562497.401336:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562497.401339:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783562497.404765:0:17059:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcf651a540 - data ffff9bfce6019a20/ffff9bfbc95cfc00 00000020:01000000:2.0:1783562497.405301:0:17059:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfceee7c360 - data ffff9bfbc88055e8/ffff9bfbc6a3f400 00100000:10000000:2.0:1783562497.419754:0:17059:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783562497.442537:0:17059:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88f57 00000020:00000080:1.0:1783562497.442556:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfceed10800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783562497.442574:0:17059:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6161000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783562497.442577:0:17059:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6161000 2 00000020:01000004:1.0:1783562497.442581:0:17059:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfcf6161000 from lustre-OST0000 00000020:00000080:1.0:1783562497.442620:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562497.442633:0:17059:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783562497.442637:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfcca2dc800/lustre-OST0000_UUID 00000020:00000080:1.0:1783562497.442640:0:17059:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcca2dc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783562497.442651:0:17059:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783562497.442716:0:17059:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783562497.442743:0:17059:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783562497.442748:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562497.442754:0:17059:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1783562497.442758:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfceed10800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:1.0:1783562497.442763:0:17059:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bfd00d45800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783562497.442773:0:17059:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9bfbc6a44d40) has exports, disconnecting them 00000020:00080000:1.0:1783562497.442780:0:17059:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bfd00d45800), last request at 1783562453 00000020:00000080:1.0:1783562497.442785:0:17059:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88f88 00000020:00080000:1.0:1783562497.442797:0:17059:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfd00d45800): rc 0 00000020:00000080:1.0:1783562497.442803:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfd00d45800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783562497.442896:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfd00d45800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783562497.448902:0:17059:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783562497.448916:0:17059:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562497.448921:0:17059:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783562497.448933:0:17059:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783562497.449082:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfd00d43000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783562497.449250:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783562497.449261:0:17059:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783562497.449267:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfbc6a55800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783562497.449272:0:17059:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6a55800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783562497.449281:0:17059:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783562497.449573:0:17059:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6161000 1 00000020:00000080:2.0:1783562497.449580:0:17059:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88f26 00000020:00000080:2.0:1783562497.449588:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfcc78df800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783562497.449830:0:17059:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783562497.449837:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562497.450242:0:17059:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783562497.450248:0:17059:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9bfcc5040000) has no exports 00000020:00000080:3.0:1783562497.450814:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc78df800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783562497.475089:0:17059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783562497.475129:0:17059:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783562497.475136:0:17059:0:(genops.c:906:class_export_put()) final put ffff9bfcf6165800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783562497.475141:0:17059:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcf6165800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783562497.475151:0:17059:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783562497.475360:0:17059:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfcf6163800 00000020:02000400:3.0:1783562497.475423:0:17059:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1783562498.104146:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562499.126749:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783562499.256611:0:17210:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783562499.263106:0:17210:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783562499.263229:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562499.263249:0:17210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562499.263258:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562499.263266:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562499.263967:0:17210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783562499.263977:0:17210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783562499.264011:0:17210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783562499.264027:0:17210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfceee2fb80 x1870200563661312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562505 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562499.264188:0:17210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfceee2e300 x1870200563661440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562499.264217:0:17210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfceee2ce00 x1870200563661696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562499.264239:0:17210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783562499.264247:0:17210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783562499.264286:0:17210:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783562499.264324:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563661824:0@lo:39:umount.0 00000400:00000100:0.0:1783562499.264391:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870200563661824 offset 0 length 224: 4 00000100:00100000:0.0:1783562499.264558:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3272:1870200563661696:0@lo:400:kworker.0 00010000:00010000:1.0:1783562499.264667:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562499.264687:0:15964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562499.264714:0:15964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562499.264720:0:15964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562499.264723:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3275:1870200563661440:0@lo:400:kworker.0 00010000:00010000:1.0:1783562499.264747:0:15964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562499.264756:0:15964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562499.264762:0:15964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562499.264765:0:15964:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783562499.264769:0:15964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783562499.264796:0:15964:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:1.0:1783562499.264800:0:15964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562499.264813:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563661312:0@lo:400:kworker.0 00010000:00010000:1.0:1783562499.264838:0:15964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b890ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b890b5 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562499.264857:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562499.264859:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562499.264861:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562500.151137:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562501.174792:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562502.198980:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783562502.518638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783562502.518653:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783562503.222939:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562504.246634:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562505.270665:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562506.294852:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562507.318703:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783562507.638503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783562507.638514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783562508.342840:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562509.367018:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562509.494553:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562499/real 1783562499] req@ffff9bfcefb89880 x1870200563661824/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562509.494587:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcefb89880 x1870200563661824/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783562509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783562509.494606:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfbc95d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783562509.494648:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563661824:0@lo:39:umount.0 00000100:00080000:2.0:1783562509.494785:0:17210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783562509.494790:0:17210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783562509.494796:0:17210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783562509.495754:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.495767:0:17210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.495774:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.495790:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.496023:0:17210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562509.496026:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562509.496035:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496036:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.496053:0:17210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496054:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562509.496061:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.496065:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496074:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562509.496076:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562509.496104:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562509.496111:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562509.496114:0:14158:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783562509.496126:0:14158:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:1.0:1783562509.496130:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496137:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6682200/0x4738ba0933b89084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b8908b expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496152:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562509.496153:0:17210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783562509.496157:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562509.496161:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783562509.496166:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1a65c20) 10000000:01000000:2.0:1783562509.496167:0:17210:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 10000000:00010000:1.0:1783562509.496172:0:14158:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496181:0:14158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562509.496188:0:14158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783562509.496194:0:17210:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 10000000:01000000:1.0:1783562509.496194:0:14158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783562509.496199:0:14158:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:01000000:2.0:1783562509.496200:0:17210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:01000000:1.0:1783562509.496201:0:14158:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:2.0:1783562509.496207:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783562509.496215:0:17210:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1783562509.496216:0:14158:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00000020:00080000:2.0:1783562509.496220:0:17210:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9bfcef648000) has no exports 00010000:00010000:1.0:1783562509.496222:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496232:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b8923d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b89244 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.496245:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562509.496247:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783562509.496260:0:17210:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9bfcef648000) has no exports 00010000:00010000:1.0:1783562509.497440:0:14158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562509.497586:0:15964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783562509.497875:0:17210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcef6b41e0 - data ffff9bfbc881ed80/ffff9bfbc90d7800 00000020:01000000:2.0:1783562509.497995:0:17210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bfcf651aa20 - data ffff9bfcd8b101b0/ffff9bfbc93e4400 00100000:10000000:2.0:1783562509.507713:0:17210:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783562509.528335:0:17210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b89099 00000020:00000080:1.0:1783562509.528345:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfbc6d01800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783562509.528367:0:17210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfd00d46000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783562509.528371:0:17210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfd00d46000 2 00000020:01000004:1.0:1783562509.528374:0:17210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bfd00d46000 from lustre-OST0001 00000020:00000080:1.0:1783562509.528396:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562509.528434:0:17210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783562509.528437:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfbc6305000/lustre-OST0001_UUID 00000020:00000080:1.0:1783562509.528440:0:17210:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6305000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783562509.528447:0:17210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783562509.528529:0:17210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e84b51d8-00f8-4fc5-9608-af3d9dda1905->MGS 00010000:00010000:1.0:1783562509.528542:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562509.528554:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562509.528560:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783562509.528563:0:17210:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783562509.528566:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783562509.528578:0:17210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:1.0:1783562509.528582:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336600/0x4738ba0933b88f34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88f3b expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562509.528606:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562509.528613:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562509.528618:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783562509.528620:0:17210:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783562509.528622:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783562509.528630:0:17210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bfcef1db800 00010000:00010000:1.0:1783562509.528633:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6337000/0x4738ba0933b88e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4738ba0933b88e2a expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562509.528647:0:17210:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1db800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783562509.528651:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783562509.528654:0:17210:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783562509.528655:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783562509.528658:0:17210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783562509.528669:0:17210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bfceee2c380 x1870200563661568/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783562512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783562509.528685:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783562509.528688:0:17210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:0.0:1783562509.528762:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e84b51d8-00f8-4fc5-9608-af3d9dda1905:3271:1870200563661568:0@lo:250:kworker.0 00000020:00000080:3.0:1783562509.528915:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6d01800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1783562509.528991:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783562509.528998:0:17210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b88e0e 00000020:00000080:1.0:1783562509.529003:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfcef1df000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 00000020:01000000:1.0:1783562509.529017:0:17210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.104@tcp (flags='') 00000020:00000080:1.0:1783562509.529023:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562509.529027:0:17210:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783562509.529031:0:17210:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9bfcf6b90000) has no exports 10000000:01000000:0.0:1783562509.529086:0:14166:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1783562509.529153:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef1df000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 for MGC192.168.204.104@tcp 10000000:01000000:1.0:1783562509.529182:0:17210:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.104@tcp: client import never connected 00000100:00080000:1.0:1783562509.529190:0:17210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783562509.529192:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783562509.529194:0:17210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783562509.529196:0:17210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783562509.529235:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562509.529239:0:17210:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.104@tcp (uuid e84b51d8-00f8-4fc5-9608-af3d9dda1905) 00000020:01000000:1.0:1783562509.529244:0:17210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783562509.529247:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562509.529250:0:17210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783562509.529254:0:17210:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bfbc95d3800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783562509.529260:0:17210:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9bfcc5cf99c0) has exports, disconnecting them 00000020:00080000:1.0:1783562509.529264:0:17210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bfbc95d3800), last request at 1783562458 00000020:00000080:1.0:1783562509.529267:0:17210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b890c3 00000020:00080000:1.0:1783562509.529277:0:17210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bfbc95d3800): rc 0 00000020:00000080:1.0:1783562509.529280:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfbc95d3800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783562509.529979:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfcef1db800 for MGC192.168.204.104@tcp 00000020:00000080:3.0:1783562509.529987:0:36:0:(genops.c:906:class_export_put()) final put ffff9bfcef1d9000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 00000020:00000080:3.0:1783562509.529990:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcef1d9000/e84b51d8-00f8-4fc5-9608-af3d9dda1905 for MGC192.168.204.104@tcp 00000020:01000000:3.0:1783562509.529995:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.104@tcp (e84b51d8-00f8-4fc5-9608-af3d9dda1905) 00010000:01000000:0.0:1783562509.530147:0:17210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783562509.530151:0:17210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783562509.530154:0:17210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783562509.530159:0:17210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783562509.530506:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783562509.530513:0:17210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1783562509.530517:0:17210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfd00d46000 1 00000020:00000080:0.0:1783562509.530522:0:17210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4738ba0933b8907d 00000020:00000080:0.0:1783562509.530541:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfbc6303800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783562509.530552:0:17210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00010000:00010000:3.0:1783562509.530602:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783562509.530678:0:15964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1783562509.530741:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783562509.530745:0:17210:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783562509.530753:0:17210:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9bfcef6499c0) has no exports 00010000:00010000:0.0:1783562509.531099:0:14158:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1783562509.533964:0:14153:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bfcc3bbf000:14153] 1 exiting: rc = 0 00000100:00100000:0.0:1783562509.542448:0:14152:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bfcf6844200:14152] 0 exiting: rc = 1 00000100:00100000:0.0:1783562509.542567:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562509.542783:0:14155:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bfcc3bbfa00:14155] 1 exiting: rc = 0 00000100:00100000:0.0:1783562509.542841:0:14832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bfcefbedc00:14832] 3 exiting: rc = 0 00000100:00100000:0.0:1783562509.542893:0:14154:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bfcef5ede00:14154] 0 exiting: rc = 1 00000100:00100000:2.0:1783562509.543155:0:14156:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bfcc3bbf400:14156] 2 exiting: rc = 0 00000100:00100000:2.0:1783562509.543221:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543231:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543243:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543251:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543256:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543265:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543274:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543281:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543288:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543296:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543301:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543309:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543317:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543325:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543333:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543341:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543347:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543352:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543357:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543365:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543372:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543377:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543384:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543391:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543399:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543434:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543441:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543446:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543452:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543458:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543465:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543471:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543479:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543563:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543578:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543585:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543591:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543596:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543602:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543607:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543612:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543617:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543622:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543629:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543634:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543639:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543644:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543649:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543655:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543660:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543666:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543676:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543682:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543687:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543692:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543696:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543701:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543705:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543710:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543714:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543718:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543723:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543727:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.543732:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783562509.544462:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc95d3800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783562509.544477:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bfbc95d6800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783562509.544482:0:36:0:(genops.c:906:class_export_put()) final put ffff9bfbc6d00800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783562509.544538:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6d00800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783562509.544549:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783562509.544582:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6303800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783562509.548339:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562509.548549:0:17210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783562509.548555:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfbc6a55000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783562509.548559:0:17210:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfbc6a55000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783562509.548566:0:17210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783562509.548720:0:17210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bfbc6a50800 00000020:01000000:1.0:1783562509.548740:0:17210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783562509.548743:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783562509.548747:0:17210:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783562509.548751:0:17210:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9bfcc5044d40) has no exports 00000020:00000080:1.0:1783562509.548772:0:17210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783562509.548778:0:17210:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783562509.548780:0:17210:0:(genops.c:906:class_export_put()) final put ffff9bfcc78da800/OSS_uuid 00000020:00000080:1.0:1783562509.548782:0:17210:0:(genops.c:865:class_export_destroy()) destroying export ffff9bfcc78da800/OSS_uuid for OSS 00000020:01000000:1.0:1783562509.548786:0:17210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1783562509.548825:0:14165:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783562509.548860:0:14803:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bfd00e04200:14803] 0 exiting: rc = 1 00000100:00100000:2.0:1783562509.549095:0:14806:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bfcc5deee00:14806] 2 exiting: rc = 0 00000100:00100000:0.0:1783562509.549134:0:15965:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bfcc7ee4c00:15965] 3 exiting: rc = 0 00000100:00100000:3.0:1783562509.550185:0:14804:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bfd00e05400:14804] 1 exiting: rc = 0 00000100:00100000:1.0:1783562509.550306:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550316:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550322:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550327:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550333:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550338:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550343:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550347:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550352:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550357:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550362:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550367:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550372:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550377:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550383:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550392:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550726:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550831:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550837:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550842:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550846:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550851:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550855:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550860:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550865:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550869:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550873:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550877:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550882:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550887:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550891:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550895:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550900:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550907:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550911:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550924:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550929:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550933:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550938:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550942:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550947:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550951:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550956:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550960:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550964:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550972:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550977:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550981:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550985:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550989:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550993:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.550998:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551002:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551006:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551010:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551014:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551018:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551023:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551029:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551033:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551038:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551042:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551047:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.551051:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.551890:0:14807:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bfcefbed000:14807] 0 exiting: rc = 1 00000100:00100000:3.0:1783562509.551900:0:16419:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bfceed37600:16419] 2 exiting: rc = 0 00000100:00100000:0.0:1783562509.551983:0:14808:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bfcefbec000:14808] 1 exiting: rc = 0 00000100:00100000:1.0:1783562509.552051:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552057:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552062:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552067:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552073:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552079:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552091:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552096:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552100:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552103:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552107:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552112:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552115:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552118:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552121:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552125:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552128:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552131:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552134:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552137:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552142:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552145:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552148:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552151:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552153:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552157:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552161:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552163:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552166:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552169:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552172:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552175:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552179:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552182:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552185:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552188:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552191:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552194:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552196:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552199:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552202:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552209:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552213:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552216:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552219:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552222:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552226:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552229:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552234:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552239:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552242:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552245:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552248:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552251:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552254:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552257:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552260:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552263:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552266:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552269:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552272:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552275:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552278:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.552281:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783562509.553255:0:14811:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bfcef11d400:14811] 2 exiting: rc = 0 00000100:00100000:3.0:1783562509.553339:0:14809:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bfcc5f22a00:14809] 0 exiting: rc = 1 00000100:00100000:2.0:1783562509.553536:0:14810:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bfcc3c9aa00:14810] 1 exiting: rc = 0 00000100:00100000:1.0:1783562509.553592:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553599:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553609:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553616:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553655:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553677:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553686:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553693:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553699:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553705:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553711:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553787:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553802:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553808:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553815:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553820:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553826:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553831:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553836:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553842:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553848:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553856:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553864:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553871:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553880:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553886:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553894:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553900:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553909:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553932:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553942:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553951:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553961:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553968:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553977:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553986:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.553995:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554005:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554012:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554020:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554027:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554035:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554044:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554052:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554060:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554067:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554076:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554088:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554095:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554104:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554110:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554119:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554125:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554211:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554218:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554230:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554236:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554242:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554258:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554265:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554271:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554276:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554282:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.554288:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.559088:0:14813:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bfceed25800:14813] 1 exiting: rc = 0 00000100:00100000:3.0:1783562509.559089:0:14812:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bfcca642a00:14812] 0 exiting: rc = 1 00000100:00100000:1.0:1783562509.559208:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559215:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559221:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559226:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559232:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559237:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559243:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559248:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559253:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559258:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559263:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559268:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559274:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559279:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559284:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559289:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559294:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559300:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559318:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559323:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559329:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559334:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559340:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559345:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559350:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559355:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559360:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559365:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559373:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559380:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559385:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559390:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559395:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559400:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559438:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559446:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559455:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559461:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559466:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559471:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559476:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559481:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559487:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559506:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559512:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559517:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559522:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559527:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559533:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559538:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559543:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559548:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559553:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559565:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559570:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559576:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559581:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559587:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559592:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559597:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559602:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559608:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559613:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.559619:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783562509.560182:0:14814:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bfbc6906600:14814] 0 exiting: rc = 1 00000100:00100000:0.0:1783562509.560210:0:14815:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bfbc6907a00:14815] 1 exiting: rc = 0 00000100:00100000:1.0:1783562509.560541:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560551:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560558:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560564:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560595:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560603:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560609:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560614:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560621:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560626:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560632:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560639:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560646:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560652:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560657:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560664:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560686:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560692:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560698:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560703:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560711:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560717:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560723:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560729:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560744:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560750:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560756:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560761:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560782:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560788:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560794:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560799:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560805:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560811:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560817:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560822:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560829:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560835:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560841:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560847:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560873:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560881:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560888:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560895:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560901:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560907:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560912:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560919:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560925:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560932:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560939:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560946:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560969:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560976:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560982:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560988:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.560994:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561000:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561015:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561029:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561043:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561050:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561056:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783562509.561063:0:17210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783562509.570225:0:17210:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783562517.096932:0:17824:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783562520.551069:0:18236:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783562520.551076:0:18236:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783562520.551200:0:18236:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfbc1e07800 00000020:01000004:0.0:1783562520.551222:0:18236:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783562520.551235:0:18236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783562520.551257:0:18236:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bfbc6a43380) 00000020:00000080:0.0:1783562520.551277:0:18236:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783562520.562735:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783562520.564597:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1783562520.564944:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1783562520.565043:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1783562520.565133:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783562520.565205:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1783562520.565262:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1783562520.565531:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783562520.565744:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1783562520.566013:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1783562520.567516:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1783562520.567633:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:0.0:1783562520.568058:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:0.0:1783562520.568272:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:0.0:1783562520.568713:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.568980:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.569199:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.569534:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:0.0:1783562520.569813:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 591: rc = 0 00100000:10000000:0.0:1783562520.570065:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.570321:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.570648:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1783562520.570933:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 591: rc = 0 00100000:10000000:0.0:1783562520.571228:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 591: rc = 0 00100000:10000000:0.0:1783562520.571802:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 610: rc = 0 00100000:10000000:0.0:1783562520.572083:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 610: rc = 0 00100000:10000000:0.0:1783562520.572363:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 610: rc = 0 00100000:10000000:0.0:1783562520.572692:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 610: rc = 0 00100000:10000000:0.0:1783562520.572960:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 610: rc = 0 00100000:10000000:0.0:1783562520.573220:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 610: rc = 0 00100000:10000000:0.0:1783562520.573621:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 610: rc = 0 00100000:10000000:0.0:1783562520.573879:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 610: rc = 0 00100000:10000000:0.0:1783562520.574120:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 610: rc = 0 00100000:10000000:0.0:1783562520.574385:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 610: rc = 0 00100000:10000000:0.0:1783562520.574685:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 610: rc = 0 00100000:10000000:0.0:1783562520.574941:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 610: rc = 0 00100000:10000000:0.0:1783562520.575180:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 610: rc = 0 00100000:10000000:0.0:1783562520.575478:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 610: rc = 0 00100000:10000000:0.0:1783562520.575722:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 610: rc = 0 00100000:10000000:0.0:1783562520.575997:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 610: rc = 0 00100000:10000000:0.0:1783562520.576249:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 610: rc = 0 00100000:10000000:0.0:1783562520.576583:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 610: rc = 0 00100000:10000000:0.0:1783562520.576851:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 610: rc = 0 00100000:10000000:0.0:1783562520.577110:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 610: rc = 0 00100000:10000000:0.0:1783562520.577375:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 610: rc = 0 00100000:10000000:0.0:1783562520.577683:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 610: rc = 0 00100000:10000000:0.0:1783562520.577945:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 610: rc = 0 00100000:10000000:0.0:1783562520.578207:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 610: rc = 0 00100000:10000000:0.0:1783562520.578518:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 610: rc = 0 00100000:10000000:0.0:1783562520.578817:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 610: rc = 0 00100000:10000000:0.0:1783562520.579071:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 610: rc = 0 00100000:10000000:0.0:1783562520.579371:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 610: rc = 0 00100000:10000000:0.0:1783562520.579652:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 610: rc = 0 00100000:10000000:0.0:1783562520.579908:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 610: rc = 0 00100000:10000000:0.0:1783562520.580148:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 610: rc = 0 00100000:10000000:0.0:1783562520.580461:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 610: rc = 0 00100000:10000000:0.0:1783562520.580882:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 599: rc = 0 00100000:10000000:0.0:1783562520.581465:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1783562520.581670:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:0.0:1783562520.581866:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1783562520.581926:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:0.0:1783562520.582118:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1783562520.582184:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:0.0:1783562520.582627:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1783562520.582683:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:0.0:1783562520.582877:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1783562520.582943:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:0.0:1783562520.583122:0:18236:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1783562520.583182:0:18236:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00000020:00000080:0.0:1783562520.583564:0:18236:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783562520.583578:0:18236:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783562520.583594:0:18236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b8986b 00000020:01000004:0.0:1783562520.583609:0:18236:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1783562520.583619:0:18236:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783562520.583634:0:18236:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfbc1e07800 from MGS 00000020:01000004:0.0:1783562520.583640:0:18236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783562520.583654:0:18236:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bfbc6a419c0) 00000020:00000080:0.0:1783562520.583669:0:18236:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783562520.583756:0:18236:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfbc1e07800 from MGS, refs=2 00080000:01000000:0.0:1783562520.583763:0:18236:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783562520.583770:0:18236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b89879 00000100:00100000:0.0:1783562520.583898:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783562520.584065:0:18236:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783562520.584075:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783562520.584826:0:18236:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783562520.584835:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783562520.585744:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562520.586009:0:18236:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783562520.586015:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783562520.587437:0:18236:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783562520.587450:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783562520.587899:0:18236:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783562520.587906:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783562520.588820:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562520.588824:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562520.588826:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562520.589055:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562520.589057:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562520.589059:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562520.589806:0:18236:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783562520.592142:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783562520.598377:0:18236:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783562520.598456:0:18236:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783562520.598460:0:18236:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1783562520.599802:0:18245:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783562520.600095:0:18236:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783562520.600217:0:18236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783562520.601552:0:18236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783562520.602033:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562520.602264:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783562520.602274:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783562520.603069:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783562520.603082:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783562520.603318:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783562520.603327:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1783562520.604206:0:18250:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1783562520.604451:0:18236:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783562520.604488:0:18236:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.104@tcp' 00000020:01000004:0.0:1783562520.604491:0:18236:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783562520.604554:0:18236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.104@tcp (typ=mgc) 00000020:00000080:0.0:1783562520.604576:0:18236:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.104@tcp (ffff9bfbc6a40000) 00000020:00000080:0.0:1783562520.604603:0:18236:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783562520.604720:0:18236:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcf66e8800@MGC192.168.204.104@tcp: add connection 192.168.204.104@tcp at head 00010000:00010000:0.0:1783562520.604940:0:18236:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.104@tcp-0 is initialized 00000040:01000000:0.0:1783562520.604948:0:18236:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783562520.605395:0:18251:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783562520.605503:0:18236:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.104@tcp (uuid 985d615a-b40a-4e93-ba73-7a6a65910c9a) 00000020:00000080:3.0:1783562520.605538:0:18236:0:(genops.c:1406:class_connect()) connect: client 985d615a-b40a-4e93-ba73-7a6a65910c9a, cookie 0x4738ba0933b89887 00000100:00080000:3.0:1783562520.605556:0:18236:0:(import.c:510:import_select_connection()) MGC192.168.204.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562520.605564:0:18236:0:(import.c:624:import_select_connection()) MGC192.168.204.104@tcp: import ffff9bfcf66e8800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562520.605636:0:18236:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9ace00 x1870200563661952/t0(0) o250->MGC192.168.204.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783562520.605667:0:18236:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 985d615a-b40a-4e93-ba73-7a6a65910c9a->MGS 00000020:01000004:3.0:1783562520.605707:0:18236:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783562520.605715:0:18236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:0.0:1783562520.605717:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:985d615a-b40a-4e93-ba73-7a6a65910c9a:3271:1870200563661952:0@lo:250:mount.lustre.0 00000020:00000080:3.0:1783562520.605735:0:18236:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bfcf6b93380) 00000020:00000080:3.0:1783562520.605758:0:18236:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783562520.605840:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.605901:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563661952 00000100:00100000:3.0:1783562520.605915:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563661952 00000100:00100000:3.0:1783562520.605978:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562520.605988:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3271:x1870200563661952:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783562520.606038:0:18247:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 985d615a-b40a-4e93-ba73-7a6a65910c9a@0@lo t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:3.0:1783562520.606073:0:18247:0:(genops.c:1406:class_connect()) connect: client 985d615a-b40a-4e93-ba73-7a6a65910c9a, cookie 0x4738ba0933b89895 00000100:00080000:3.0:1783562520.606274:0:18247:0:(import.c:65:import_set_state_nolock()) ffff9bfce8855800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562520.606389:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:3271:x1870200563661952:12345-0@lo:250:mount.lustre.0 Request processed in 401us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.606398:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562520.606641:0:3271:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783562520.606657:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1783562520.606678:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783562520.606684:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783562520.606691:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcf66e8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783562520.606695:0:3271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783562520.606707:0:3271:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783562520.606719:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:985d615a-b40a-4e93-ba73-7a6a65910c9a:3271:1870200563661952:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783562520.612418:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562520.612601:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562520.612606:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783562520.613204:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562520.613212:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783562520.614301:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562520.614311:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783562520.615243:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562520.615396:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783562520.615420:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783562520.615722:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783562520.615728:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783562520.639820:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562520.640062:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783562520.640069:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783562520.641098:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783562520.641106:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783562520.641721:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783562520.641885:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783562520.641890:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783562520.642229:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783562520.642235:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783562520.642748:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562520.642880:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783562520.642885:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783562520.643558:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783562520.643564:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783562520.644083:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562520.644224:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783562520.644229:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783562520.644914:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783562520.644921:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783562520.658710:0:18236:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562520.658926:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783562520.658932:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783562520.660072:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783562520.660081:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783562520.662585:0:18236:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783562520.662602:0:18236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783562520.663600:0:18236:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783562520.663629:0:18236:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1783562520.663637:0:18236:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783562520.663803:0:18236:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783562520.663845:0:18236:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783562520.663851:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783562520.663853:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783562520.663854:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562520.663856:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562520.663857:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562520.663859:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562520.663861:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783562520.663862:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783562520.663864:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562520.663865:0:18236:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562520.663868:0:18236:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783562520.663870:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783562520.663872:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783562520.663873:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562520.663874:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562520.663876:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562520.663877:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562520.663878:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783562520.663879:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783562520.663880:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562520.663881:0:18236:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562520.663908:0:18236:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783562520.663929:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783562520.664015:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.664070:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f180 going to sleep for 11 seconds 00000100:00100000:2.0:1783562520.664158:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662080 00000100:00100000:2.0:1783562520.664167:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662080 00000100:00100000:2.0:1783562520.664217:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562520.664226:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:18236:x1870200563662080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783562520.664271:0:18249:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783562520.664278:0:18249:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783562520.664294:0:18249:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1783562520.665368:0:18270:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783562520.665818:0:18249:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1783562520.666682:0:18271:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783562520.666688:0:18271:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783562520.666690:0:18271:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783562520.666727:0:18271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1783562520.666985:0:18249:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783562520.666996:0:18249:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783562520.676045:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:18236:x1870200563662080:12345-0@lo:253:mount.lustre.0 Request processed in 11810us (12019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562520.676060:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562520.676070:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783562520.676099:0:18236:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783562520.676102:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783562520.676103:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783562520.676105:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562520.676106:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562520.676107:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562520.676108:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562520.676109:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783562520.676110:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783562520.676112:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562520.676113:0:18236:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783562520.676128:0:18236:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfbc1e07800 from lustre-MDT0000 10000000:01000000:3.0:1783562520.676152:0:18236:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783562520.676155:0:18236:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783562520.676159:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bfbc6a40000 10000000:01000000:3.0:1783562520.676163:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562520.676171:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bfbc6a40000 from 1 10000000:01000000:3.0:1783562520.676174:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783562520.676211:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.676222:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.676232:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562520.676252:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562520.676281:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.676327:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.676425:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662208 00000100:00100000:0.0:1783562520.676437:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662208 00000100:00100000:0.0:1783562520.676473:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562520.676482:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:18236:x1870200563662208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562520.676495:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562520.676525:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698f000/0x4738ba0933b898a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8989c expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.676548:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698f000/0x4738ba0933b898a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8989c expref: 6 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.676559:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698f000/0x4738ba0933b898a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8989c expref: 6 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.676568:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f000, rc 0) 00000100:00100000:0.0:1783562520.676608:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+6:18236:x1870200563662208:12345-0@lo:101:mount.lustre.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.676614:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562520.676656:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562520.676666:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.676677:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562520.676710:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562520.676729:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.676745:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562520.676773:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662336 00000100:00100000:2.0:1783562520.676778:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662336 00000100:00100000:2.0:1783562520.676808:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783562520.676815:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+6:18236:x1870200563662336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562520.680543:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+6:18236:x1870200563662336:12345-0@lo:501:mount.lustre.0 Request processed in 3715us (3798us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783562520.680562:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562520.680673:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783562520.680719:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783562520.680789:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.680801:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562520.680812:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfbc1e07800 10000000:01000000:3.0:1783562520.680817:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783562520.680822:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bfbc1e07800 10000000:01000000:3.0:1783562520.680825:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783562520.680828:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9bfbc1e07800 from 1 10000000:01000000:3.0:1783562520.680832:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783562520.680868:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.680876:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.680888:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562520.680938:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562520.680974:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.681010:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.681115:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662464 00000100:00100000:0.0:1783562520.681122:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662464 00000100:00100000:0.0:1783562520.681174:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783562520.681184:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+6:18236:x1870200563662464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562520.681197:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562520.681211:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698f800/0x4738ba0933b898b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b898aa expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.681238:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698f800/0x4738ba0933b898b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b898aa expref: 7 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.681250:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698f800/0x4738ba0933b898b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b898aa expref: 7 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.681272:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f800, rc 0) 00000100:00100000:0.0:1783562520.681323:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+7:18236:x1870200563662464:12345-0@lo:101:mount.lustre.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.681330:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562520.681355:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562520.681369:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898b1 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.681379:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b898b1 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562520.681394:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783562520.681443:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898b1 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.681452:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3000/0x4738ba0933b898aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898b1 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562520.681459:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783562520.681463:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562520.681468:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bfbc1e07800 10000000:01000000:3.0:1783562520.681471:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783562520.681474:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783562520.681476:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562520.681489:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.681497:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.681511:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562520.681524:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562520.681549:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.681575:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562520.681692:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662592 00000100:00100000:2.0:1783562520.681697:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662592 00000100:00100000:2.0:1783562520.681740:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562520.681747:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+7:18236:x1870200563662592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562520.681754:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562520.681765:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b898bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b898b8 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562520.681779:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b898bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b898b8 expref: 8 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562520.681787:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6336a00/0x4738ba0933b898bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b898b8 expref: 8 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562520.681793:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6336a00, rc 0) 00000100:00100000:2.0:1783562520.681833:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+8:18236:x1870200563662592:12345-0@lo:101:mount.lustre.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562520.681840:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562520.681873:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562520.681884:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898bf expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.681892:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b898bf expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562520.681933:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562520.682183:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562520.682201:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.682230:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662720 00000100:00100000:3.0:1783562520.682235:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662720 00000100:00100000:3.0:1783562520.682266:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783562520.682273:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+8:18236:x1870200563662720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562520.682906:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18236:x1870200563662720:12345-0@lo:501:mount.lustre.0 Request processed in 633us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.682914:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783562520.682944:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562520.682977:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562520.683014:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562520.683049:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.683062:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662848 00000100:00100000:3.0:1783562520.683067:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662848 00000100:00100000:3.0:1783562520.683145:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783562520.683154:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18236:x1870200563662848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562520.683467:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18236:x1870200563662848:12345-0@lo:503:mount.lustre.0 Request processed in 314us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.683475:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783562520.683512:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563662848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562520.683956:0:18272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18272:1870200563662976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562520.683991:0:18272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562520.684055:0:18272:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.684088:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563662976 00000100:00100000:1.0:1783562520.684093:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563662976 00000100:00100000:1.0:1783562520.684129:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783562520.684137:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18272:x1870200563662976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562520.684443:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18272:x1870200563662976:12345-0@lo:502:llog_process_th.0 Request processed in 305us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.684450:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562520.684680:0:18272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18272:1870200563662976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783562520.684714:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562520.684725:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562520.684728:0:18272:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783562520.684734:0:18272:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783562520.684736:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783562520.684752:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bfbc6a44d40) 00000020:00000080:0.0:1783562520.684772:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783562520.684778:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783562520.684843:0:18272:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783562520.684850:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b898cd 00000020:00000080:0.0:1783562520.685078:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783562520.685083:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562520.685086:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562520.685088:0:18272:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783562520.685090:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562520.685093:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562520.685094:0:18272:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783562520.685097:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783562520.685356:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bfcef6499c0) 00000020:00000080:0.0:1783562520.685368:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783562520.685374:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783562520.685376:0:18272:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783562520.685379:0:18272:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783562520.685386:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783562520.685445:0:18272:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfbc1e07800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783562520.685459:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bfcef648000) 00000020:00000080:0.0:1783562520.685467:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783562520.685571:0:18272:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783562520.685576:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b898e2 00000020:00000080:0.0:1783562520.685653:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783562520.685657:0:18272:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783562520.685660:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4738ba0933b898e9 00080000:01000000:0.0:1783562520.685668:0:18272:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783562520.685670:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b898f0 00010000:00010000:0.0:1783562520.725218:0:18272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1783562520.725752:0:18272:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934680 00000001:00080000:1.0:1783562520.725931:0:18272:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783562520.726520:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bfcc5cf8000) 00000020:00000080:1.0:1783562520.726540:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783562520.726602:0:18272:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783562520.726607:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b898fe 00000020:00000080:3.0:1783562520.730865:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783562520.736277:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4738ba0933b89905 00000020:00000080:1.0:1783562520.736927:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783562520.736938:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562520.736944:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.736947:0:18272:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783562520.736951:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783562520.736954:0:18272:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783562520.736956:0:18272:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562520.736957:0:18272:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562520.736959:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783562520.736961:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.736963:0:18272:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783562520.736966:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562520.736971:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.736978:0:18272:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783562520.736985:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783562520.737027:0:18272:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783562520.737048:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562520.737052:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.737053:0:18272:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783562520.737056:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562520.737059:0:18272:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783562520.737063:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.737064:0:18272:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783562520.737067:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783562520.737072:0:18272:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:1.0:1783562520.737169:0:18272:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783562520.737173:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562520.737195:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bfcc5cfcd40) 00000020:00000080:1.0:1783562520.737210:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783562520.737216:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783562520.737269:0:18272:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783562520.737275:0:18272:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783562520.737291:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b89913 00010000:00080000:1.0:1783562520.737321:0:18272:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcf6fbd000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562520.737568:0:18272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1783562520.737907:0:18272:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783562520.737953:0:18272:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783562520.738817:0:18272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562520.738876:0:18272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1783562520.738941:0:18272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1783562520.739619:0:18276:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783562520.739624:0:18276:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783562520.740122:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783562520.740132:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783562520.740167:0:18272:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783562520.740201:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b8991a 00000100:00080000:1.0:1783562520.740210:0:18272:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562520.740216:0:18272:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bfcf6fbd000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562520.740250:0:18272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2f800 x1870200563663104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562520.740292:0:18272:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1783562520.740370:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563663104:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783562520.740481:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870200563663104 offset 0 length 520: 4 00000020:01000000:1.0:1783562520.741137:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562520.741143:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.741144:0:18272:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783562520.741148:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783562520.741150:0:18272:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783562520.741152:0:18272:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562520.741153:0:18272:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783562520.741154:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783562520.741157:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.741158:0:18272:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783562520.741161:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562520.741164:0:18272:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783562520.741167:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562520.741169:0:18272:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783562520.741172:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783562520.741176:0:18272:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.104@tcp to nid 0x20000c0a8cc68 (192.168.204.104@tcp) 00000020:01000000:1.0:1783562520.741207:0:18272:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783562520.741210:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562520.741222:0:18272:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bfcc5cfb380) 00000020:00000080:1.0:1783562520.741235:0:18272:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1783562520.741239:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783562520.741479:0:18272:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783562520.741485:0:18272:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783562520.741491:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4738ba0933b89928 00010000:00080000:1.0:1783562520.741536:0:18272:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcef1dc000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562520.741758:0:18272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1783562520.741934:0:18272:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783562520.741954:0:18272:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783562520.742525:0:18272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562520.742586:0:18272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1783562520.742664:0:18272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1783562520.743331:0:18278:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783562520.743340:0:18278:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783562520.744586:0:18272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783562520.744613:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783562520.744679:0:18272:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783562520.744713:0:18272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b8992f 00000100:00080000:3.0:1783562520.744726:0:18272:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783562520.744734:0:18272:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcef1dc000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:3.0:1783562520.744782:0:18272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef9afb80 x1870200563663232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562520.744863:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563663232:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783562520.744944:0:3271:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870200563663232 offset 0 length 520: 4 00000100:00080000:3.0:1783562520.745178:0:18272:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783562520.745245:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.745256:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.745259:0:18272:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783562520.745263:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562520.745268:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.745270:0:18272:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783562520.745273:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783562520.745276:0:18272:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783562520.745278:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.745295:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.745296:0:18272:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783562520.745300:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562520.745302:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.745304:0:18272:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783562520.745308:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783562520.745349:0:18272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18272:1870200563663360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562520.745463:0:18272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.745499:0:18272:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.745542:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563663360 00000100:00100000:0.0:1783562520.745556:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563663360 00000100:00080000:2.0:1783562520.745592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562520.745600:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783562520.745637:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783562520.745651:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18272:x1870200563663360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562520.745971:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18272:x1870200563663360:12345-0@lo:502:llog_process_th.0 Request processed in 322us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.745979:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562520.746089:0:18272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18272:1870200563663360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783562520.746122:0:18272:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.746126:0:18272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.746128:0:18272:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783562520.746130:0:18272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783562520.746443:0:18236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1783562520.746476:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783562520.746496:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898bf expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.746508:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2600/0x4738ba0933b898b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898bf expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562520.746516:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfbc1e07800 from 1 10000000:01000000:0.0:1783562520.746519:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783562520.746557:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.746565:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.746582:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562520.746604:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783562520.746644:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562520.746697:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.746699:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563663488 00000100:00100000:3.0:1783562520.746714:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563663488 00000100:00100000:3.0:1783562520.746763:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783562520.746772:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+9:18236:x1870200563663488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562520.746787:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562520.746810:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89936 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.746836:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89936 expref: 10 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.746851:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89936 expref: 10 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.746863:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d3200, rc 0) 00000100:00100000:3.0:1783562520.747003:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+10:18236:x1870200563663488:12345-0@lo:101:mount.lustre.0 Request processed in 231us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.747011:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783562520.747356:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562520.747374:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.747385:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.748563:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663616:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783562520.748623:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.748667:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.748668:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563663616 00000100:00100000:0.0:1783562520.748675:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563663616 00000100:00100000:0.0:1783562520.748730:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783562520.748741:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+10:18236:x1870200563663616:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783562520.748761:0:18249:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783562520.748770:0:18249:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783562520.748868:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+10:18236:x1870200563663616:12345-0@lo:256:mount.lustre.0 Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.748877:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783562520.748894:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663616:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783562520.749608:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783562520.749629:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.749638:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562520.749644:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfbc1e07800 from 1 10000000:01000000:1.0:1783562520.749646:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562520.749671:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.749803:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.749819:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.749850:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562520.749917:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.749973:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.750030:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563663744 00000100:00100000:3.0:1783562520.750045:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563663744 00000100:00100000:3.0:1783562520.750089:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562520.750097:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+10:18236:x1870200563663744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562520.750106:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562520.750121:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89944 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.750144:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89944 expref: 11 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.750156:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89944 expref: 11 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562520.750173:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2200, rc 0) 00000100:00100000:3.0:1783562520.750222:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563663744:12345-0@lo:101:mount.lustre.0 Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.750229:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783562520.750297:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562520.750316:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.750327:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.750392:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562520.750485:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.750508:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.750529:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563663872 00000100:00100000:0.0:1783562520.750536:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563663872 00000100:00100000:0.0:1783562520.750575:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783562520.750583:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563663872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562520.750969:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563663872:12345-0@lo:501:mount.lustre.0 Request processed in 385us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.750977:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783562520.750999:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563663872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562520.751027:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562520.751064:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.751094:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.751108:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664000 00000100:00100000:3.0:1783562520.751115:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664000 00000100:00100000:3.0:1783562520.751155:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783562520.751162:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563664000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562520.751503:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563664000:12345-0@lo:503:mount.lustre.0 Request processed in 341us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.751512:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783562520.751667:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562520.752380:0:18280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18280:1870200563664128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562520.752506:0:18280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.752539:0:18280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc801f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.752552:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664128 00000100:00100000:0.0:1783562520.752559:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664128 00000100:00100000:0.0:1783562520.752599:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783562520.752608:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18280:x1870200563664128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783562520.752817:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18280:x1870200563664128:12345-0@lo:502:llog_process_th.0 Request processed in 210us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.752825:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783562520.752844:0:18280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18280:1870200563664128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783562520.752875:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562520.752885:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.752887:0:18280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783562520.752895:0:18280:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfbc1e07800 00000020:00000080:3.0:1783562520.752898:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783562520.752905:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.752907:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.752908:0:18280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783562520.752911:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562520.752913:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.752914:0:18280:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783562520.752925:0:18280:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfbc1e07800 00000020:00000080:3.0:1783562520.752928:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783562520.753048:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.753052:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.753054:0:18280:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783562520.753056:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783562520.753059:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.753060:0:18280:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783562520.753064:0:18280:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfbc1e07800 00000020:00000080:3.0:1783562520.753066:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783562520.756192:0:18280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18280:1870200563664256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562520.756270:0:18280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.756323:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664256 00000100:00100000:3.0:1783562520.756330:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664256 00000100:00100000:3.0:1783562520.756372:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562520.756380:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18280:x1870200563664256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783562520.756620:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18280:x1870200563664256:12345-0@lo:502:llog_process_th.0 Request processed in 239us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.756628:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783562520.756680:0:18280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0d27840 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.756703:0:18280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18280:1870200563664256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783562520.756730:0:18280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783562520.756738:0:18280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783562520.756740:0:18280:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783562520.756744:0:18280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783562520.756920:0:18236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783562520.756952:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562520.756977:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.756989:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562520.757034:0:18236:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783562520.757037:0:18236:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfbc1e07800 10000000:01000000:1.0:1783562520.757040:0:18236:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfbc1e07800 10000000:01000000:1.0:1783562520.757044:0:18236:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783562520.757049:0:18236:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfbc1e07800 from 1 10000000:01000000:1.0:1783562520.757052:0:18236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783562520.757075:0:18236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.757084:0:18236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.757093:0:18236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.757107:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562520.757138:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.757168:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5b180 going to sleep for 11 seconds 00000100:00100000:0.0:1783562520.757168:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664384 00000100:00100000:0.0:1783562520.757175:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664384 00000100:00100000:0.0:1783562520.757207:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783562520.757214:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563664384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562520.757223:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562520.757237:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b89959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89952 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.757258:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b89959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89952 expref: 12 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.757266:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698f200/0x4738ba0933b89959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89952 expref: 12 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.757273:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f200, rc 0) 00000100:00100000:0.0:1783562520.757329:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563664384:12345-0@lo:101:mount.lustre.0 Request processed in 114us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.757338:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783562520.757339:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1783562520.757355:0:18236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89959 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.757365:0:18236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89959 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.757431:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562520.757449:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.757459:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562520.759777:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664512 00000100:00100000:3.0:1783562520.759792:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664512 00000100:00100000:3.0:1783562520.759841:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783562520.759850:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563664512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562520.760152:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563664512:12345-0@lo:501:mount.lustre.0 Request processed in 302us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562520.760160:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783562520.760921:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562520.760974:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562520.761016:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.761049:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.761147:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664640 00000100:00100000:1.0:1783562520.761153:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664640 00000100:00100000:1.0:1783562520.761190:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562520.761199:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563664640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562520.761393:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563664640:12345-0@lo:503:mount.lustre.0 Request processed in 195us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.761421:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783562520.761474:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563664640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783562520.761729:0:18285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18285:1870200563664768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562520.761777:0:18285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.761805:0:18285:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.761831:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664768 00000100:00100000:1.0:1783562520.761835:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664768 00000100:00100000:1.0:1783562520.761867:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783562520.761876:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18285:x1870200563664768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562520.762160:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18285:x1870200563664768:12345-0@lo:502:llog_process_th.0 Request processed in 285us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.762175:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783562520.762231:0:18285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18285:1870200563664768:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783562520.762306:0:18285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783562520.762323:0:18285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bfcc5cf99c0) 00000020:00000080:1.0:1783562520.762347:0:18285:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1783562520.762539:0:18285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfbc1e07800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783562520.762544:0:18285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfbc1e07800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783562520.762547:0:18285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfbc1e07800 4 00010000:00080000:1.0:1783562520.762579:0:18285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcd170a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562520.764522:0:18285:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1783562520.764646:0:18285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783562520.764689:0:18285:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783562520.764763:0:18285:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4738ba0933b89967 00000100:00080000:1.0:1783562520.764776:0:18285:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562520.764783:0:18285:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bfcd170a800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562520.764824:0:18285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2dc00 x1870200563664896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562520.764854:0:18285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783562520.764874:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563664896:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783562520.764887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562520.764894:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783562520.764952:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562520.765106:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563664896 00000100:00100000:3.0:1783562520.765114:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563664896 00000100:00100000:3.0:1783562520.765150:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562520.765158:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563664896:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783562520.765261:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563664896:12345-0@lo:38:llog_process_th.0 Request processed in 101us (308us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783562520.765270:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562520.765558:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783562520.765567:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd170a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562520.765571:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783562520.765576:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563664896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783562520.767633:0:18285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18285:1870200563665024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562520.767775:0:18285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.767813:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665024 00000100:00100000:1.0:1783562520.767820:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665024 00000100:00100000:1.0:1783562520.767857:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783562520.767864:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18285:x1870200563665024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783562520.768082:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18285:x1870200563665024:12345-0@lo:502:llog_process_th.0 Request processed in 218us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.768096:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783562520.768144:0:18285:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.768166:0:18285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:985d615a-b40a-4e93-ba73-7a6a65910c9a:18285:1870200563665024:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783562520.768194:0:18285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783562520.768260:0:18236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783562520.768293:0:18236:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562520.768315:0:18236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89959 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.768330:0:18236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1499400/0x4738ba0933b89952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89959 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783562520.768383:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783562520.768386:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562520.768387:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562520.768389:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562520.768390:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562520.768392:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562520.768394:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562520.768396:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562520.768399:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562520.768425:0:18236:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562520.768430:0:18236:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783562520.768433:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783562520.768435:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562520.768436:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562520.768438:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562520.768439:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562520.768441:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562520.768442:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562520.768443:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562520.768444:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562520.768446:0:18236:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562520.768464:0:18236:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783562520.768474:0:18236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563665152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562520.768508:0:18236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.768532:0:18236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd0f5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.768551:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665152 00000100:00100000:1.0:1783562520.768555:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665152 00000100:00100000:1.0:1783562520.768584:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783562520.768592:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18236:x1870200563665152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783562520.768613:0:18247:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783562520.768627:0:18247:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783562520.792864:0:18247:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783562520.792884:0:18247:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783562520.793038:0:18270:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783562520.793045:0:18270:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783562520.793071:0:18270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.793091:0:18270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89936 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.793100:0:18270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.793155:0:18270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.793175:0:18270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 12 pid: 18247 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562520.793193:0:18270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563665280:0@lo:104: 00000100:00100000:0.0:1783562520.793555:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562520.793615:0:18270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc898c600 going to sleep for 11 seconds 00000100:00100000:1.0:1783562520.793616:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665280 00000100:00100000:1.0:1783562520.793627:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665280 00000100:00100000:1.0:1783562520.793679:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562520.793691:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563665280:12345-0@lo:104: 00010000:00010000:1.0:1783562520.793708:0:18237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793787:0:18237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783562520.793795:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563665280:12345-0@lo:104: Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562520.793803:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562520.793809:0:18270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563665280:0@lo:104: 00010000:00010000:1.0:1783562520.793829:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562520.793835:0:18270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793838:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793856:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698ea00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562520.793861:0:18243:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793889:0:18243:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562520.793898:0:18243:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562520.793906:0:18243:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562520.793947:0:18243:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793955:0:18243:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562520.793985:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.793993:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf698ea00/0x4738ba0933b89936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8993d expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794014:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562520.794017:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562520.794017:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:985d615a-b40a-4e93-ba73-7a6a65910c9a:3273:1870200563665408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562520.794021:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562520.794061:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562520.794106:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665408 00000100:00100000:1.0:1783562520.794111:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665408 00010000:00010000:1.0:1783562520.794127:0:18239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 13 pid: 18247 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.794158:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562520.794165:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+13:3273:x1870200563665408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562520.794177:0:18239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562520.794182:0:18239:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 13 pid: 18247 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794201:0:18239:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 13 pid: 18247 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794216:0:18239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d3200/0x4738ba0933b8993d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b89936 expref: 13 pid: 18247 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794234:0:18239:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794242:0:18239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562520.794255:0:18239:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001211925s 00010000:00010000:1.0:1783562520.794259:0:18239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794266:0:18239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794273:0:18239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794292:0:18239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794300:0:18239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562520.794307:0:18239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794316:0:18239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794342:0:18239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562520.794355:0:18239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562520.794367:0:18270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562520.794379:0:18270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.794393:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:3273:x1870200563665408:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (329us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562520.794396:0:18270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698e800/0x4738ba0933b8996e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562520.794432:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562520.794438:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:985d615a-b40a-4e93-ba73-7a6a65910c9a:3273:1870200563665408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562520.800467:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18236:x1870200563665152:12345-0@lo:253:mount.lustre.0 Request processed in 31863us (31946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562520.800489:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783562520.800705:0:18236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18236:1870200563665152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783562520.800729:0:18236:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783562520.800734:0:18236:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783562520.800737:0:18236:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783562520.800738:0:18236:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562520.800740:0:18236:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562520.800741:0:18236:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562520.800742:0:18236:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562520.800744:0:18236:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783562520.800746:0:18236:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783562520.800748:0:18236:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562520.800750:0:18236:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783562520.800769:0:18236:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783562520.808638:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562520.808866:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562520.809160:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562520.809324:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562520.809643:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562520.809895:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562520.810786:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562520.810955:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562520.811222:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562520.811695:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783562520.811949:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783562520.812058:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783562520.826611:0:18236:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:0.0:1783562520.826889:0:18236:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783562520.826934:0:18291:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:2.0:1783562520.826940:0:18291:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:01000000:2.0:1783562520.827122:0:18292:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1783562520.827200:0:18292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783562520.829158:0:18236:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783562520.829247:0:18292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1783562520.829277:0:18236:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1783562520.829331:0:18292:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783562520.829337:0:18292:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1783562520.829744:0:18236:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783562520.829751:0:18236:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783562520.829869:0:18236:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783562520.830683:0:18236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783562520.831111:0:18236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783562520.831140:0:18236:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783562520.831618:0:18236:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1783562520.832331:0:18236:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1783562520.836043:0:18236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1783562520.853335:0:18236:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783562520.853375:0:18236:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac9e01c3f988 00100000:10000000:0.0:1783562520.853382:0:18236:0:(lfsck_lib.c:3088:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783562520.853857:0:18236:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783562520.853872:0:18236:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783562520.853889:0:18236:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1783562520.853906:0:18236:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783562521.655156:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562521.782723:0:18288:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783562521.782737:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562521.783284:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1783562521.783293:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1783562522.103505:0:18251:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783562522.103517:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfbc1e07800 from 9 10000000:01000000:0.0:1783562522.103522:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783562522.103641:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562522.103660:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562522.103673:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562522.103769:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563665536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783562522.103861:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562522.103913:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c55000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562522.103997:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665536 00000100:00100000:3.0:1783562522.104007:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665536 00000100:00100000:3.0:1783562522.104059:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783562522.104066:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:18251:x1870200563665536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562522.104081:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562522.104098:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89975 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562522.104125:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89975 expref: 12 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562522.104136:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89975 expref: 12 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562522.104147:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc13d2c00, rc 0) 00000100:00100000:3.0:1783562522.104224:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563665536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562522.104228:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783562522.104994:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563665536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562522.105020:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562522.105031:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562522.105098:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563665664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783562522.105136:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562522.105170:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c55000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562522.105797:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665664 00000100:00100000:3.0:1783562522.105804:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665664 00000100:00100000:3.0:1783562522.105847:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783562522.105855:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563665664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783562522.105875:0:18247:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783562522.105890:0:18247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783562522.105894:0:18247:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1783562522.106013:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563665664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562522.106021:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783562522.106035:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563665664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783562522.106077:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783562522.106084:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562522.106098:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562522.679612:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783562522.756754:0:18535:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1783562522.806913:0:18288:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783562522.806924:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562522.806983:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1783562522.807003:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783562523.702542:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783562524.150111:0:18686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5c8ee900 20000000:00000080:2.0:1783562524.150129:0:18686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfcc3e8f000 uarg=0000000000000000 20000000:01000000:2.0:1783562524.150162:0:18686:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783562524.150167:0:18686:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783562524.150172:0:18686:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783562524.150846:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1783562524.150910:0:18686:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783562524.154162:0:18686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783562524.154189:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154204:0:18686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89944 expref: 11 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154210:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154260:0:18686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 11 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154271:0:18686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 11 pid: 18247 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562524.154283:0:18686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18686:1870200563665792:0@lo:104: 00000100:00100000:0.0:1783562524.154334:0:18686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562524.154383:0:18686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c55000 going to sleep for 11 seconds 00000100:00100000:3.0:1783562524.154450:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665792 00000100:00100000:3.0:1783562524.154458:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665792 00000100:00100000:3.0:1783562524.154509:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562524.154518:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18686:x1870200563665792:12345-0@lo:104: 00010000:00010000:3.0:1783562524.154530:0:18238:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562524.154584:0:18238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1783562524.154591:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562524.154598:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562524.154600:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18686:x1870200563665792:12345-0@lo:104: Request processed in 83us (264us total) trans 0 rc 0/0 00010000:00010000:0.0:1783562524.154605:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498800 already unused, calling callback (ffffffffc1a65c20) 00000100:00100000:3.0:1783562524.154608:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:00010000:0.0:1783562524.154613:0:18243:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154621:0:18243:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562524.154629:0:18686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18686:1870200563665792:0@lo:104: 10000000:00010000:0.0:1783562524.154632:0:18243:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562524.154641:0:18243:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783562524.154655:0:18686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154678:0:18243:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154686:0:18243:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562524.154709:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154716:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498800/0x4738ba0933b89944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8994b expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562524.154729:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562524.154730:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783562524.154771:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563665920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783562524.154800:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562524.154806:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562524.154872:0:18241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563665920 00000100:00100000:2.0:1783562524.154877:0:18241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563665920 00010000:00010000:2.0:1783562524.154895:0:18241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 12 pid: 18247 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562524.154915:0:18241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562524.154928:0:18241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:3274:x1870200563665920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562524.154938:0:18241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562524.154943:0:18241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 12 pid: 18247 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154954:0:18241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 12 pid: 18247 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154966:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2200/0x4738ba0933b8994b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b89944 expref: 12 pid: 18247 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154977:0:18241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154984:0:18241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154993:0:18241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.154998:0:18241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155002:0:18241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155005:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155008:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698ee00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562524.155011:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155020:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155030:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562524.155036:0:18241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562524.155063:0:18241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:985d615a-b40a-4e93-ba73-7a6a65910c9a+11:3274:x1870200563665920:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562524.155070:0:18241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562524.155091:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563665920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562524.155286:0:18686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562524.155294:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562524.155301:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89983 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562524.726508:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562525.750570:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783562526.071577:0:18251:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783562526.071590:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfbc1e07800 from 10 10000000:01000000:3.0:1783562526.071598:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00080000:1.0:1783562526.071627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562526.071633:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783562526.071637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:3.0:1783562526.071638:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562526.071641:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783562526.071646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783562526.071655:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:3.0:1783562526.071659:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562526.071661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bfcd170a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562526.071675:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bfcd170a800 using connection 192.168.204.104@tcp/0@lo 00010000:00010000:3.0:1783562526.071677:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.071704:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562526.071708:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2df80 x1870200563666304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562526.071725:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:985d615a-b40a-4e93-ba73-7a6a65910c9a:3275:1870200563666048:0@lo:400:kworker.0 00000100:00100000:1.0:1783562526.071787:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563666304:0@lo:38:kworker.0 00000100:00100000:3.0:1783562526.071796:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562526.071796:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562526.071849:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.071862:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5e7eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.071892:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666176 00000100:00100000:3.0:1783562526.071896:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666048 00000100:00100000:0.0:1783562526.071901:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666176 00000100:00100000:3.0:1783562526.071902:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666048 00000100:00100000:1.0:1783562526.071933:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666304 00000100:00100000:1.0:1783562526.071939:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666304 00000100:00100000:0.0:1783562526.071963:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783562526.071971:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562526.071973:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783562526.071977:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563666176:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562526.071981:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3271:x1870200563666304:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783562526.071988:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:3275:x1870200563666048:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1783562526.072008:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:1.0:1783562526.072016:0:18256:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 335 last 0 00010000:00010000:0.0:1783562526.072032:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b8998a expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.072059:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b8998a expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783562526.072063:0:18256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4738ba0933b89991 00010000:00010000:0.0:1783562526.072075:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8998a expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:1.0:1783562526.072081:0:18256:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:0.0:1783562526.072087:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698ec00, rc 0) 00000100:00100000:0.0:1783562526.072131:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+13:18251:x1870200563666176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.072140:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+13:3275:x1870200563666048:12345-0@lo:400:kworker.0 Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.072144:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783562526.072156:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783562526.072231:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:985d615a-b40a-4e93-ba73-7a6a65910c9a:3275:1870200563666048:0@lo:400:kworker.0 00000100:00100000:0.0:1783562526.072265:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562526.072282:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.072292:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562526.072339:0:18256:0:(import.c:65:import_set_state_nolock()) ffff9bfcc8060800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562526.072357:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562526.072427:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562526.072446:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218480 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.072460:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666432 00000100:00100000:0.0:1783562526.072464:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666432 00000100:00100000:0.0:1783562526.072497:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783562526.072504:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563666432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562526.072769:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563666432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.072779:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1783562526.072793:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfceee2df80 x1870200563666304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562526.072794:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1870200563666304:12345-0@lo:38:kworker.0 Request processed in 417us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562526.072814:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562526.072820:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562526.072862:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666560:0@lo:503:ll_cfg_requeue.0 00000100:00080000:3.0:1783562526.072883:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783562526.072896:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783562526.072904:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783562526.072908:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd170a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783562526.072912:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.072920:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3271:1870200563666304:0@lo:38:kworker.0 00000100:00100000:0.0:1783562526.072951:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218480 going to sleep for 11 seconds 00000100:00100000:1.0:1783562526.073038:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666560 00000100:00100000:1.0:1783562526.073043:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666560 00000100:00100000:1.0:1783562526.073072:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783562526.073080:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563666560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562526.073363:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18251:x1870200563666560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562526.073372:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783562526.073393:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563666560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783562526.074067:0:18884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783562526.074160:0:18251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783562526.074197:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783562526.074210:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.074228:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783562526.108925:0:18887:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783562526.108931:0:18887:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783562526.109085:0:18887:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfcc3f25000 00000020:01000004:2.0:1783562526.109104:0:18887:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783562526.109118:0:18887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783562526.109130:0:18887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bfcc6733380) 00000020:00000080:2.0:1783562526.109149:0:18887:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783562526.120963:0:18887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783562526.121394:0:18887:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783562526.122354:0:18887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783562526.122662:0:18887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783562526.122914:0:18887:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1783562526.123247:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 225: rc = 0 00100000:10000000:2.0:1783562526.123307:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 225: rc = 0 00100000:10000000:2.0:1783562526.123521:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 225: rc = 0 00100000:10000000:2.0:1783562526.124692:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1783562526.124923:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1783562526.125166:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1783562526.125363:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1783562526.125628:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1783562526.125798:0:18887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00000020:00000080:2.0:1783562526.126266:0:18887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783562526.126277:0:18887:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783562526.126285:0:18887:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b899a6 00000020:01000004:2.0:1783562526.126292:0:18887:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783562526.126310:0:18887:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783562526.126314:0:18887:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783562526.126318:0:18887:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783562526.126321:0:18887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783562526.126330:0:18887:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bfcc67319c0) 00000020:00000080:2.0:1783562526.126338:0:18887:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783562526.127602:0:18887:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562526.127757:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783562526.127764:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783562526.130784:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783562526.130798:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783562526.131251:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783562526.131258:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783562526.132591:0:18887:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562526.132758:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783562526.132764:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783562526.133134:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783562526.133140:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783562526.146095:0:18887:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562526.146340:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783562526.146348:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783562526.147536:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783562526.147549:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783562526.148229:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783562526.148239:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783562526.150201:0:18887:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783562526.150398:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783562526.150443:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783562526.152939:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783562526.152953:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783562526.177917:0:18887:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783562526.178122:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783562526.178129:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783562526.180195:0:18887:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783562526.180211:0:18887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783562526.180709:0:18887:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783562526.180734:0:18887:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783562526.180740:0:18887:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783562526.193896:0:18887:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783562526.193936:0:18887:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.104@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783562526.193940:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783562526.193942:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562526.193943:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562526.193945:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562526.193946:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562526.193947:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562526.193953:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562526.193956:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562526.193957:0:18887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562526.193960:0:18887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783562526.193963:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783562526.193964:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562526.193965:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562526.193966:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562526.193967:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562526.193968:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562526.193968:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562526.193970:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562526.193971:0:18887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783562526.193996:0:18887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783562526.194017:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783562526.194097:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.194172:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcca2fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.195303:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666688 00000100:00100000:0.0:1783562526.195317:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666688 00000100:00100000:0.0:1783562526.195387:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783562526.195398:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18887:x1870200563666688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783562526.195681:0:18248:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783562526.195686:0:18248:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783562526.195690:0:18248:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783562526.205172:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18887:x1870200563666688:12345-0@lo:253:mount.lustre.0 Request processed in 9764us (11063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.205202:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783562526.205224:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783562526.205247:0:18887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783562526.205251:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783562526.205252:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783562526.205254:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783562526.205255:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783562526.205257:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783562526.205258:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783562526.205260:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783562526.205262:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783562526.205264:0:18887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783562526.205295:0:18887:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfcc3f25000 from lustre-OST0000 10000000:01000000:3.0:1783562526.205325:0:18887:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783562526.205328:0:18887:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783562526.205335:0:18887:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfbc6a40000 local copy 00010000:00010000:3.0:1783562526.205347:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.206029:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562526.206077:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.206162:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783562526.206206:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666816 00000100:00100000:1.0:1783562526.206213:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666816 00000100:00100000:1.0:1783562526.206257:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783562526.206265:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18887:x1870200563666816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562526.206587:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18887:x1870200563666816:12345-0@lo:501:mount.lustre.0 Request processed in 322us (509us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783562526.206595:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783562526.206705:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783562526.206720:0:18887:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783562526.206862:0:18887:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783562526.206870:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.206879:0:18887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562526.206901:0:18887:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcc3f25000 10000000:01000000:3.0:1783562526.206907:0:18887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783562526.206913:0:18887:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bfbc6a40000 10000000:01000000:3.0:1783562526.206915:0:18887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783562526.206918:0:18887:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9bfbc6a40000 from 1 10000000:01000000:3.0:1783562526.206921:0:18887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783562526.206945:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.206953:0:18887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.206963:0:18887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.206975:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562526.207000:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.207035:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783562526.207222:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563666944 00000100:00100000:2.0:1783562526.207228:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563666944 00000100:00100000:2.0:1783562526.207268:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783562526.207276:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+12:18887:x1870200563666944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562526.207286:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562526.207300:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b899bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b899b4 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562526.207321:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b899bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b899b4 expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562526.207332:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6337e00/0x4738ba0933b899bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b899b4 expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562526.207341:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6337e00, rc 0) 00000100:00100000:2.0:1783562526.207378:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+13:18887:x1870200563666944:12345-0@lo:101:mount.lustre.0 Request processed in 104us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.207385:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783562526.207442:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563666944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562526.207456:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899bb expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.207466:0:18887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b899bb expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562526.207481:0:18887:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783562526.207572:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899bb expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.207580:0:18887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3c00/0x4738ba0933b899b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899bb expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562526.207587:0:18887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783562526.207591:0:18887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562526.207595:0:18887:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783562526.207597:0:18887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783562526.207622:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.207629:0:18887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.207637:0:18887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.207649:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562526.207674:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.207745:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.207871:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667072 00000100:00100000:0.0:1783562526.207877:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667072 00000100:00100000:0.0:1783562526.207940:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783562526.207949:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+13:18887:x1870200563667072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562526.207956:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562526.207966:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698e000/0x4738ba0933b899c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b899c2 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.207991:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698e000/0x4738ba0933b899c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b899c2 expref: 14 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.208000:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698e000/0x4738ba0933b899c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b899c2 expref: 14 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.208007:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e000, rc 0) 00000100:00100000:0.0:1783562526.208047:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667072:12345-0@lo:101:mount.lustre.0 Request processed in 101us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.208053:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783562526.208129:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562526.208141:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899c9 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562526.208150:0:18887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b899c9 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562526.211730:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1783562526.212614:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562526.212857:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783562526.212912:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783562526.212952:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783562526.212997:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783562526.213034:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783562526.213076:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783562526.213149:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783562526.213200:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783562526.213236:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1783562526.213281:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1783562526.213317:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1783562526.213360:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1783562526.213474:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1783562526.213483:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1783562526.213582:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562526.213655:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.213695:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.213800:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667200 00000100:00100000:0.0:1783562526.213810:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667200 00000100:00100000:0.0:1783562526.213882:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783562526.213892:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562526.214287:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667200:12345-0@lo:501:mount.lustre.0 Request processed in 395us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.214297:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783562526.214319:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562526.214355:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562526.214391:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562526.214446:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667328 00000100:00100000:0.0:1783562526.214452:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667328 00000100:00100000:2.0:1783562526.214464:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.214542:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783562526.214551:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562526.214856:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667328:12345-0@lo:503:mount.lustre.0 Request processed in 305us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.214862:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783562526.214923:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783562526.215836:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562526.215914:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.215966:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.216014:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.216151:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667456 00000100:00100000:3.0:1783562526.216158:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667456 00000100:00100000:3.0:1783562526.216210:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783562526.216220:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562526.216558:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667456:12345-0@lo:502:mount.lustre.0 Request processed in 338us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.216565:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783562526.216737:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562526.216970:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783562526.217023:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1783562526.217059:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1783562526.217111:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1783562526.217149:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1783562526.217197:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1783562526.217246:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1783562526.217284:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1783562526.217318:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1783562526.217365:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1783562526.217552:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1783562526.217610:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1783562526.217651:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562526.217713:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562526.217788:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5c55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562526.217841:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667584 00000100:00100000:2.0:1783562526.217848:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667584 00000100:00100000:2.0:1783562526.217938:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783562526.217948:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.218143:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667584:12345-0@lo:502:mount.lustre.0 Request processed in 196us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.218151:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783562526.218235:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562526.218304:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1783562526.218315:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1783562526.219241:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562526.219251:0:18901:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783562526.219258:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562526.219260:0:18901:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783562526.219266:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562526.219282:0:18901:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bfcf712cd40) 00000020:00000080:1.0:1783562526.219304:0:18901:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783562526.219311:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783562526.219393:0:18901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcc3f25000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783562526.219421:0:18901:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783562526.219430:0:18901:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4738ba0933b899d7 00010000:00010000:1.0:1783562526.222942:0:18901:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783562526.223453:0:18901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:1.0:1783562526.225472:0:18901:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1783562526.229953:0:18901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783562526.229978:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562526.230006:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230009:0:18901:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783562526.230014:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783562526.230017:0:18901:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1783562526.230019:0:18901:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783562526.230021:0:18901:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783562526.230023:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783562526.230025:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230027:0:18901:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783562526.230030:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562526.230033:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230035:0:18901:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783562526.230039:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783562526.230041:0:18901:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783562526.230044:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562526.230047:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230048:0:18901:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783562526.230051:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783562526.230054:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230056:0:18901:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783562526.230060:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783562526.230193:0:18901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783562526.230198:0:18901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783562526.230201:0:18901:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783562526.230206:0:18901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1783562526.230360:0:18887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783562526.230475:0:18887:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783562526.230511:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899c9 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.230527:0:18887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2200/0x4738ba0933b899c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899c9 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562526.230540:0:18887:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc3f25000 from 1 10000000:01000000:3.0:1783562526.230543:0:18887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783562526.230603:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.230612:0:18887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.230625:0:18887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.230662:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562526.230760:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.230833:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.230913:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667712 00000100:00100000:0.0:1783562526.230938:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667712 00000100:00100000:0.0:1783562526.231015:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783562526.231029:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+14:18887:x1870200563667712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562526.231055:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562526.231083:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b899de expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.231131:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b899de expref: 15 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.231160:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b899de expref: 15 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.231172:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698f400, rc 0) 00000100:00100000:0.0:1783562526.231342:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563667712:12345-0@lo:101:mount.lustre.0 Request processed in 315us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.231355:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783562526.231494:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562526.231522:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.231535:0:18887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562526.232196:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1783562526.234901:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562526.235600:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1783562526.235694:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1783562526.235803:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1783562526.235877:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1783562526.235917:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1783562526.235969:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1783562526.236001:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1783562526.236043:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1783562526.236275:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1783562526.236314:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1783562526.236505:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562526.236640:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.236697:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e780 going to sleep for 11 seconds 00000100:00100000:2.0:1783562526.236729:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667840 00000100:00100000:2.0:1783562526.236745:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667840 00000100:00100000:2.0:1783562526.236819:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783562526.236830:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563667840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562526.237242:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563667840:12345-0@lo:501:mount.lustre.0 Request processed in 413us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.237254:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783562526.237304:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562526.237345:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562526.237389:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.237440:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.237474:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563667968 00000100:00100000:0.0:1783562526.237481:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563667968 00000100:00100000:0.0:1783562526.237531:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783562526.237540:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563667968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562526.237748:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563667968:12345-0@lo:503:mount.lustre.0 Request processed in 207us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.237757:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783562526.237811:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563667968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783562526.238712:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562526.238825:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.238904:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.239077:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.241803:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668096 00000100:00100000:3.0:1783562526.241817:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668096 00000100:00100000:3.0:1783562526.241897:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783562526.241908:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563668096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562526.242218:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563668096:12345-0@lo:502:mount.lustre.0 Request processed in 311us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.242227:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783562526.242324:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562526.242622:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783562526.242676:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783562526.242723:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783562526.242755:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783562526.242786:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783562526.242832:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783562526.242863:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783562526.242890:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1783562526.242926:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.242994:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.243035:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.243063:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668224 00000100:00100000:3.0:1783562526.243069:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668224 00000100:00100000:3.0:1783562526.243106:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783562526.243114:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563668224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562526.243296:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563668224:12345-0@lo:502:mount.lustre.0 Request processed in 181us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.243304:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783562526.243318:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562526.243396:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783562526.243430:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783562526.244241:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562526.244317:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244321:0:18905:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783562526.244330:0:18905:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc3f25000 00000020:00000080:2.0:1783562526.244333:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562526.244340:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562526.244342:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244344:0:18905:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783562526.244346:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562526.244348:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244350:0:18905:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783562526.244353:0:18905:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcc3f25000 00000020:00000080:2.0:1783562526.244355:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562526.244492:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562526.244496:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244498:0:18905:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783562526.244500:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562526.244502:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244503:0:18905:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783562526.244507:0:18905:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcc3f25000 00000020:00000080:2.0:1783562526.244508:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562526.244737:0:18905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562526.244741:0:18905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562526.244742:0:18905:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783562526.244745:0:18905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1783562526.245199:0:18887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783562526.245220:0:18887:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562526.245243:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.245255:0:18887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562526.245308:0:18887:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783562526.245312:0:18887:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcc3f25000 10000000:01000000:3.0:1783562526.245315:0:18887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcc3f25000 10000000:01000000:3.0:1783562526.245319:0:18887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562526.245324:0:18887:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcc3f25000 from 1 10000000:01000000:3.0:1783562526.245327:0:18887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562526.245361:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.245380:0:18887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.245391:0:18887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.245445:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562526.245498:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.245528:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.245600:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668352 00000100:00100000:0.0:1783562526.245607:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668352 00000100:00100000:0.0:1783562526.245660:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783562526.245670:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563668352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562526.245683:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562526.245697:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698fe00/0x4738ba0933b899f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b899ec expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.245720:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698fe00/0x4738ba0933b899f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b899ec expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.245731:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698fe00/0x4738ba0933b899f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b899ec expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.245750:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698fe00, rc 0) 00000100:00100000:0.0:1783562526.245795:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668352:12345-0@lo:101:mount.lustre.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.245801:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783562526.246159:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562526.246173:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899f3 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562526.246202:0:18887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b899f3 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562526.247396:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1783562526.248894:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562526.249209:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783562526.249271:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783562526.249308:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783562526.249375:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783562526.249446:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783562526.249499:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783562526.249534:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783562526.249567:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783562526.250765:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783562526.250810:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783562526.250845:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783562526.250895:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783562526.250932:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783562526.250966:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783562526.251014:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783562526.251052:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783562526.251086:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783562526.251149:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783562526.251204:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783562526.251242:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783562526.251293:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783562526.251331:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783562526.251367:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783562526.251434:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783562526.251472:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1783562526.251506:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1783562526.251565:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1783562526.252747:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1783562526.252792:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1783562526.252856:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1783562526.252889:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1783562526.252920:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1783562526.252954:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1783562526.253022:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1783562526.253060:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1783562526.253108:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1783562526.253144:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1783562526.253191:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1783562526.253242:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1783562526.253275:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1783562526.253386:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1783562526.253394:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1783562526.253538:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562526.254720:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.254774:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783562526.258288:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668480 00000100:00100000:1.0:1783562526.258304:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668480 00000100:00100000:1.0:1783562526.258364:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783562526.258375:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562526.258725:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668480:12345-0@lo:501:mount.lustre.0 Request processed in 352us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562526.258733:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783562526.258745:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562526.258795:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562526.258841:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.258868:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668608 00000100:00100000:3.0:1783562526.258873:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668608 00000100:00100000:2.0:1783562526.258878:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.258905:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783562526.258912:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562526.259065:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668608:12345-0@lo:503:mount.lustre.0 Request processed in 154us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.259070:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562526.259072:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:2.0:1783562526.260749:0:18887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562526.260828:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.260888:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.260918:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.260930:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668736 00000100:00100000:3.0:1783562526.260936:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668736 00000100:00100000:3.0:1783562526.260963:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783562526.260972:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.261698:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562526.261959:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1783562526.262009:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1783562526.262043:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1783562526.262092:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1783562526.263253:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1783562526.263346:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1783562526.263385:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000100:00100000:3.0:1783562526.263480:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668736:12345-0@lo:502:mount.lustre.0 Request processed in 2504us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.263492:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:2.0:1783562526.263495:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1783562526.263554:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1783562526.263664:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1783562526.263703:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1783562526.263762:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1783562526.263796:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1783562526.263828:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1783562526.263873:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1783562526.263907:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1783562526.263938:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1783562526.263982:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1783562526.264013:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1783562526.264044:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1783562526.264088:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1783562526.264132:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1783562526.264163:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1783562526.264225:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1783562526.264261:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1783562526.264294:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1783562526.264341:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1783562526.264377:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1783562526.264432:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1783562526.264482:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1783562526.264518:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1783562526.264564:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1783562526.265717:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1783562526.265779:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1783562526.265811:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1783562526.265855:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1783562526.265886:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1783562526.265935:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1783562526.265977:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1783562526.266006:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1783562526.266053:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562526.266126:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.266186:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd219f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.266263:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668864 00000100:00100000:3.0:1783562526.266271:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668864 00000100:00100000:3.0:1783562526.266323:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783562526.266341:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562526.266625:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563668864:12345-0@lo:502:mount.lustre.0 Request processed in 285us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562526.266632:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783562526.267317:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563668864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562526.269337:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1783562526.269363:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783562526.271243:0:18910:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783562526.271262:0:18910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bfcc6730000) 00000020:00000080:2.0:1783562526.271288:0:18910:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783562526.271490:0:18910:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcc3f25000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783562526.271495:0:18910:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcc3f25000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783562526.271499:0:18910:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcc3f25000 3 00010000:00080000:2.0:1783562526.271544:0:18910:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfcd0d37800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.104@tcp at head 00010000:00010000:2.0:1783562526.273380:0:18910:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1783562526.273545:0:18910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783562526.273590:0:18910:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783562526.273606:0:18910:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4738ba0933b89a01 00000100:00080000:2.0:1783562526.273618:0:18910:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783562526.273625:0:18910:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bfcd0d37800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:2.0:1783562526.273666:0:18910:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfcef1a8e00 x1870200563668992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783562526.273704:0:18910:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783562526.273735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562526.273741:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783562526.273745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783562526.273748:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783562526.274014:0:18910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1783562526.274368:0:18887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783562526.274435:0:18887:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783562526.274459:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899f3 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.274471:0:18887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030400/0x4738ba0933b899ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b899f3 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783562526.274535:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783562526.274542:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783562526.274544:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562526.274545:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562526.274546:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562526.274548:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562526.274550:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562526.274552:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562526.274554:0:18887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562526.274559:0:18887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783562526.274561:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783562526.274563:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783562526.274564:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562526.274565:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562526.274566:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562526.274567:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562526.274568:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562526.274569:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562526.274570:0:18887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783562526.274592:0:18887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783562526.274612:0:18887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563669120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562526.274709:0:18887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562526.274752:0:18887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562526.275467:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563668992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783562526.275512:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562526.275521:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669120 00000100:00100000:2.0:1783562526.275529:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669120 00000100:00100000:2.0:1783562526.275577:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783562526.275588:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18887:x1870200563669120:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562526.275639:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563668992 00000100:00100000:1.0:1783562526.275643:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563668992 00000100:00100000:1.0:1783562526.275701:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562526.275708:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3271:x1870200563668992:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783562526.275736:0:18254:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:1.0:1783562526.275769:0:18254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4738ba0933b89a08 00000004:00100000:1.0:1783562526.275785:0:18254:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783562526.275818:0:18254:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6886800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562526.275868:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1870200563668992:12345-0@lo:38:llog_process_th.0 Request processed in 158us (355us total) trans 0 rc 0/0 20000000:01000000:2.0:1783562526.275902:0:18249:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00010000:00080000:3.0:1783562526.275912:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bfcef1a8e00 x1870200563668992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 20000000:01000000:2.0:1783562526.275917:0:18249:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783562526.275922:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783562526.275930:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1783562526.275938:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783562526.275943:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783562526.275945:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d37800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783562526.275952:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3271:1870200563668992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783562526.276394:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:0.0:1783562526.299356:0:18249:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783562526.299373:0:18249:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783562526.299469:0:18270:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783562526.299474:0:18270:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783562526.299498:0:18270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.299518:0:18270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89975 expref: 16 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.299529:0:18270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.299572:0:18270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 16 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.299599:0:18270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 16 pid: 18249 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562526.299613:0:18270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563669248:0@lo:104: 00000100:00100000:3.0:1783562526.299678:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562526.299813:0:18270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562526.299870:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669248 00000100:00100000:0.0:1783562526.299877:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669248 00000100:00100000:0.0:1783562526.299963:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562526.299974:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563669248:12345-0@lo:104: 00010000:00010000:0.0:1783562526.299989:0:18238:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562526.300048:0:18238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783562526.300055:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563669248:12345-0@lo:104: Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562526.300063:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562526.300089:0:18270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563669248:0@lo:104: 00010000:00010000:2.0:1783562526.300116:0:18270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300288:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562526.300296:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300303:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:1.0:1783562526.300307:0:18242:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300314:0:18242:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783562526.300319:0:18242:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562526.300323:0:18242:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783562526.300387:0:18242:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300392:0:18242:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783562526.300439:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300444:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e200/0x4738ba0933b89975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b8997c expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300458:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562526.300459:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562526.300460:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562526.300538:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563669376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783562526.300562:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562526.300605:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669376 00000100:00100000:1.0:1783562526.300609:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669376 00010000:00010000:1.0:1783562526.300631:0:18239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 17 pid: 18249 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562526.300665:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783562526.300670:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:3272:x1870200563669376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562526.300679:0:18239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562526.300682:0:18239:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 17 pid: 18249 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300690:0:18239:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 17 pid: 18249 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300700:0:18239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc13d2c00/0x4738ba0933b8997c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b89975 expref: 17 pid: 18249 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300712:0:18239:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300719:0:18239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783562526.300729:0:18239:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001255893s 00010000:00010000:1.0:1783562526.300732:0:18239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300737:0:18239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300743:0:18239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300747:0:18239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300755:0:18239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0030200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562526.300759:0:18239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300764:0:18239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300781:0:18239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562526.300790:0:18239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562526.300814:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:3272:x1870200563669376:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562526.300819:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562526.300947:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563669376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562526.300972:0:18270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.300985:0:18270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562526.300992:0:18270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0030200/0x4738ba0933b89a0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562526.306280:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18887:x1870200563669120:12345-0@lo:253:mount.lustre.0 Request processed in 30684us (31560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562526.306298:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783562526.306441:0:18887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:18887:1870200563669120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783562526.306459:0:18887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783562526.306463:0:18887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783562526.306464:0:18887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783562526.306466:0:18887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562526.306468:0:18887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562526.306469:0:18887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562526.306471:0:18887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562526.306472:0:18887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562526.306474:0:18887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562526.306476:0:18887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783562526.306492:0:18887:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783562526.306908:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562526.307051:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562526.307233:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562526.307378:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783562526.307591:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783562526.307763:0:18887:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783562526.308376:0:18887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1783562526.355168:0:18887:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783562526.355192:0:18887:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783562526.355237:0:18887:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783562526.355328:0:18887:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783562526.355359:0:18887:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783562526.355394:0:18887:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783562526.776823:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562527.801279:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783562527.991152:0:18251:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783562527.991163:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfbc1e07800 from 10 10000000:01000000:2.0:1783562527.991172:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783562527.991246:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562527.991291:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562527.991308:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562527.991348:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563669504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562527.991548:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562527.991629:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7999300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562527.991739:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669504 00000100:00100000:3.0:1783562527.991750:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669504 00000100:00100000:3.0:1783562527.991816:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783562527.991827:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+15:18251:x1870200563669504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562527.991845:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562527.991864:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89a16 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562527.991891:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 16 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562527.991913:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 16 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562527.992021:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031200, rc 0) 00000100:00100000:3.0:1783562527.992080:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18251:x1870200563669504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562527.992088:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783562527.992466:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563669504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562527.992484:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562527.992496:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562527.992563:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563669632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783562527.992600:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562527.992676:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc7999300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562527.992716:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669632 00000100:00100000:0.0:1783562527.992721:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669632 00000100:00100000:0.0:1783562527.992761:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783562527.992769:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18251:x1870200563669632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783562527.992788:0:18249:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783562527.992808:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783562527.992812:0:18249:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783562527.993028:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18251:x1870200563669632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 259us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562527.993041:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783562527.993108:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563669632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783562527.993187:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783562527.993196:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562527.993206:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562528.822635:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562529.445165:0:19256:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783562529.847183:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562530.359475:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562520/real 1783562520] req@ffff9bfcef9afb80 x1870200563663232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562530.359514:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfcef9afb80 x1870200563663232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562530.359526:0:3271:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783562520/real 1783562520] req@ffff9bfceee2f800 x1870200563663104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562530.359539:0:3271:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bfceee2f800 x1870200563663104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783562530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783562530.359567:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562530.359597:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783562530.359601:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563663232:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783562530.359607:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6fbd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783562530.359612:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783562530.359615:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563663104:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783562530.361286:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562530.361293:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783562530.361297:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6fbd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562530.361304:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 329 00000100:00080000:1.0:1783562530.361310:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783562530.361318:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bfcf6fbd000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562530.361347:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2e680 x1870200563669888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783562530.361369:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562530.361372:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783562530.361374:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562530.361378:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 330 00000100:00080000:1.0:1783562530.361381:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783562530.361386:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcef1dc000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562530.361400:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2d180 x1870200563670016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783562530.361490:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563670144:0@lo:400:kworker.0 00000100:00100000:1.0:1783562530.361563:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562530.361630:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783562530.361636:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563670272:0@lo:400:kworker.0 00000100:00100000:1.0:1783562530.361660:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562530.361708:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670144 00000100:00100000:1.0:1783562530.361718:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670144 00000100:00100000:1.0:1783562530.361768:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670272 00000100:00100000:1.0:1783562530.361772:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670272 00000100:00100000:1.0:1783562530.361807:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562530.361821:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563670144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562530.361879:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563670144:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562530.361887:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562530.361909:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562530.361916:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563670272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562530.361948:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563670272:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562530.361954:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562530.361987:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563669888:0@lo:8:kworker.0 00000100:00100000:1.0:1783562530.362021:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562530.362053:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563670016:0@lo:8:kworker.0 00000100:00100000:1.0:1783562530.362079:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783562530.362147:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2f800 x1870200563670272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562530.362164:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563670272:0@lo:400:kworker.0 00010000:00080000:1.0:1783562530.362178:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2f100 x1870200563670144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783562530.362202:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563670144:0@lo:400:kworker.0 00000100:00100000:2.0:1783562530.362236:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669888 00000100:00100000:2.0:1783562530.362243:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669888 00000100:00100000:2.0:1783562530.362268:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670016 00000100:00100000:2.0:1783562530.362271:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670016 00000100:00100000:2.0:1783562530.362288:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562530.362296:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3271:x1870200563669888:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783562530.362297:0:18891:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783562530.362310:0:18891:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1783562530.362332:0:18889:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:2.0:1783562530.362376:0:18889:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b89a24 00002000:00100000:2.0:1783562530.362397:0:18889:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bfcd0d31000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783562530.362435:0:18889:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783562530.362439:0:18889:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783562530.362546:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562530.362552:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3271:x1870200563670016:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783562530.362565:0:19334:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783562530.362944:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562530.362962:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563669760:0@lo:400:kworker.0 00000100:00100000:0.0:1783562530.363019:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562530.363068:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563669760 00000100:00100000:0.0:1783562530.363073:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563669760 00000100:00100000:0.0:1783562530.363127:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783562530.363136:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:3272:x1870200563669760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562530.363186:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:3272:x1870200563669760:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00002000:00080000:2.0:1783562530.363198:0:18889:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1783562530.363204:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1783562530.363238:0:18889:0:(import.c:65:import_set_state_nolock()) ffff9bfcd0d30000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562530.363256:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563669760:0@lo:400:kworker.0 00000100:00100000:2.0:1783562530.363296:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563669888:12345-0@lo:8:kworker.0 Request processed in 998us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562530.363305:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783562530.363346:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2e680 x1870200563669888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562530.363358:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783562530.363366:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783562530.363376:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783562530.363385:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783562530.363389:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783562530.363390:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcf6fbd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783562530.363456:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783562530.363472:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563669888:0@lo:8:kworker.0 00000004:00080000:3.0:1783562530.363655:0:18276:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783562530.363986:0:18276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339620582437ns, next at 0ns, rc = 0 00000004:00080000:0.0:1783562530.364141:0:18277:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:0.0:1783562530.364164:0:18277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18277:1870200563670528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783562530.364202:0:18277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562530.364228:0:18277:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562530.364261:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783562530.364273:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563670400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562530.364318:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562530.365177:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670528 00000100:00100000:3.0:1783562530.365186:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670528 00000100:00100000:3.0:1783562530.365249:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562530.365259:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18277:x1870200563670528:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783562530.365807:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670400 00000100:00100000:0.0:1783562530.365814:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670400 00000100:00100000:0.0:1783562530.365849:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783562530.365859:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563670400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562530.365890:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562530.365987:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1870200563670400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562530.365995:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783562530.367011:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1783562530.368785:0:18891:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783562530.368798:0:18891:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1783562530.368804:0:18891:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00010000:00080000:0.0:1783562530.370390:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfcefb8b480 x1870200563670400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562530.370449:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3273:1870200563670400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562530.376954:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3271:x1870200563670016:12345-0@lo:8:kworker.0 Request processed in 14394us (14867us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783562530.376970:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783562530.377239:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783562530.377246:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783562530.377252:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563670016:0@lo:8:kworker.0 00000004:00080000:2.0:1783562530.382476:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1783562530.393881:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.393899:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.393922:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.393928:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.393936:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.393961:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.393975:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.393983:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.394018:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.394691:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.394703:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.394714:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.394720:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.394731:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.394758:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.394771:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.394794:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.394796:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.394797:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.394958:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.394966:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.394974:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.394977:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.394988:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.394999:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395007:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395014:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395068:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.395501:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.395518:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395528:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.395531:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.395536:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395546:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395554:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395572:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.395986:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783562530.395997:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562530.396006:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.396018:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.396920:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.397128:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.397136:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.397146:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.397159:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.397170:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.397198:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.397206:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89a39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.397229:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.397231:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.397232:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.397237:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.397238:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.397296:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.397303:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.397314:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.397319:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.397325:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.397338:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.397348:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.397357:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.397506:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.397798:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397810:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397824:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397832:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397850:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.397855:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397870:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.397873:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397880:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397890:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397897:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.397911:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.397914:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.398295:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.398303:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.398319:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.398323:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.398328:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.398341:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.398350:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.398359:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.398471:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.398481:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.398490:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.398491:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.398495:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.398504:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.398530:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.398539:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.398541:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.398543:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.398782:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.398787:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562530.399595:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.399602:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.399611:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.399614:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.399619:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.399640:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.399650:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.399660:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.400202:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.400212:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.400223:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.400228:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.400238:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.400256:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.400266:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.400268:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.400270:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.400310:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.400317:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.401163:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.401270:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.401283:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401296:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.401300:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.401305:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401320:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401342:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401349:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401429:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.401947:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.401954:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401963:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.401966:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.401971:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401981:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401989:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.401996:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402085:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562530.402094:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402121:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.402126:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402136:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402155:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402163:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89a55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402185:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.402189:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402196:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.402199:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402206:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402216:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402230:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.402232:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.402234:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.402307:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.402312:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89a5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562530.402806:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.402813:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.402824:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.402827:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.402831:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.402842:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.402850:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.402859:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402919:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.402925:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402934:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.402938:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402946:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402958:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.402985:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.402987:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.402989:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.403023:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.403027:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89a63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562530.403536:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.403542:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.403551:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.403555:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.403559:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.403568:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.403577:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.403583:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.403607:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.403628:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.403636:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.403646:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.403650:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.403660:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.403682:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.403690:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89a6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.403711:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.403713:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.403726:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.404056:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.404062:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404070:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.404073:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.404083:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404092:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404112:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404119:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404141:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.404312:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.404319:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404328:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.404331:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404341:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404353:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404361:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89a71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404396:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.404398:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.404400:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.404579:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.404585:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404594:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.404597:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.404601:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404611:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404618:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404635:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.404656:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.404675:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.404682:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404691:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.404696:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404705:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404719:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404727:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.404747:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.404750:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.404754:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.405074:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.405080:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405089:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.405091:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.405095:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405115:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405122:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405129:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405150:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.405256:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.405262:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405284:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.405289:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405311:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405325:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405334:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405354:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.405357:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.405359:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.405585:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.405591:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405604:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.405607:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.405611:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405619:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405627:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405634:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.405655:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.405963:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.405974:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.405983:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.405991:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406001:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406034:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406043:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a65c34e8/0x4738ba0933b89a86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406060:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.406063:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.406065:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.406069:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.406077:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406085:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.406088:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.406091:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.406177:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.406210:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406231:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406239:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406260:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.406370:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.406377:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406386:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.406391:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406399:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406425:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406434:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091420298/0x4738ba0933b89a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.406461:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.406469:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.406472:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.406742:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.406748:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406757:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.406759:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.406763:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406772:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406780:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406787:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.406815:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.407207:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.407212:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407220:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.407223:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.407226:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407235:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407242:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407250:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407324:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783562530.407842:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.407849:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407858:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.407867:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.407871:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407880:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407889:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.407896:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.407961:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562530.407969:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.407978:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.407989:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.407998:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408016:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408023:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aefc529/0x4738ba0933b89a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408041:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562530.408045:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408051:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.408055:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408062:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408070:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408077:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fdd1a1/0x4738ba0933b89a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408095:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.408110:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408117:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.408120:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408126:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408136:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.408145:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.408146:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.408147:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.409594:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.409693:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783562530.409695:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.409705:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bdb7b96/0x4738ba0933b89aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562530.410552:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.410560:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.410572:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.410575:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.410579:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.410590:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.410604:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.410609:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.410632:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562530.410651:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.410659:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.410668:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.410673:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.410693:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.410712:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.410720:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cae1358/0x4738ba0933b89aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.410737:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.410739:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.410741:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.411040:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.411047:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411055:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.411058:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.411063:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411072:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411081:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411089:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411164:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.411585:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.411590:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411597:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.411599:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.411602:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411608:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411613:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411620:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.411700:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783562530.411718:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562530.411725:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411735:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.411739:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411748:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411762:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411770:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811397a8/0x4738ba0933b89ab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411783:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.411786:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411793:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.411801:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411809:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411820:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411827:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f85a27/0x4738ba0933b89ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.411900:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.411902:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.411904:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.412031:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.412150:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.412157:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412165:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.412175:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.412180:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412190:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412199:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412206:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412221:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562530.412245:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.412253:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.412262:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.412265:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.412274:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.412286:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.412301:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5aaa374/0x4738ba0933b89abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.412318:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.412320:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.412322:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.412888:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.412895:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412903:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.412906:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.412911:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412920:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412930:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.412946:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.413007:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.413392:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.413397:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.413426:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.413429:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.413433:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.413442:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.413450:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.413457:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413532:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562530.413540:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413548:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.413552:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413561:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413577:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413591:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083715964/0x4738ba0933b89ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413610:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.413613:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413619:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.413623:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413631:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413642:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.413649:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.413650:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.413653:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.414025:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.414031:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bbfa4f/0x4738ba0933b89acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562530.414558:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.414564:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.414573:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.414576:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.414581:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.414596:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.414606:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.414614:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.414696:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.414703:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.414712:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6337000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.414716:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.414724:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.414737:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.414746:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.414747:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.414749:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.414782:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.414787:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e72c0ecd/0x4738ba0933b89ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.415024:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.415183:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.415188:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415201:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.415203:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.415206:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415212:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415217:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415223:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415264:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.415652:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.415658:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415666:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.415669:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.415673:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415681:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415700:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.415707:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415748:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783562530.415752:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415757:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.415764:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415769:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415778:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415783:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb615fb3/0x4738ba0933b89ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415794:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.415796:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415800:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.415802:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415806:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415811:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.415814:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.415818:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.415820:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.415845:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.415851:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000391e7a0c/0x4738ba0933b89ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.415870:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.416229:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.416233:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416239:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.416241:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.416243:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416250:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416255:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416266:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416279:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562530.416301:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.416312:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.416320:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.416323:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.416332:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.416343:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.416351:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.416365:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.416367:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.416369:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.416657:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.416663:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416671:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.416674:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.416678:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416687:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416695:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416702:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.416752:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562530.416971:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562530.416976:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.416984:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562530.416988:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.416995:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.417007:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.417015:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4fbd16/0x4738ba0933b89aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562530.417041:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.417043:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562530.417045:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783562530.417138:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.417144:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417158:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.417161:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.417165:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417175:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417182:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417188:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417245:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783562530.417621:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562530.417627:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417635:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1783562530.417638:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562530.417642:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417651:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417669:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562530.417675:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417731:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562530.417738:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417745:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.417748:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417766:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417778:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417785:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b4f74b/0x4738ba0933b89af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417799:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562530.417802:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417809:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562530.417812:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417819:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417828:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562530.417835:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.417836:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562530.417843:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562530.417907:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783562530.417913:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e915b3c/0x4738ba0933b89afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783562530.418114:0:18891:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00010000:00010000:3.0:1783562530.418182:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562530.418247:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18277:x1870200563670528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 52984us (54039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562530.418259:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562530.418375:0:18277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18277:1870200563670528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783562530.418396:0:18277:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:0.0:1783562530.418680:0:18277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18277:1870200563670656:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783562530.418716:0:18277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562530.418794:0:18277:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783562530.418869:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670656 00000100:00100000:2.0:1783562530.418877:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670656 00000100:00100000:2.0:1783562530.418928:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783562530.418937:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18277:x1870200563670656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783562530.418990:0:18889:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1783562530.421884:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18277:x1870200563670656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2941us (3160us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783562530.421899:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562530.421990:0:18277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18277:1870200563670656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783562530.422010:0:18277:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:1.0:1783562530.872916:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783562531.751018:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1783562531.751093:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783562531.896370:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783562532.022802:0:18288:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562532.022823:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562532.023306:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 3 00000040:00080000:2.0:1783562532.023318:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783562532.918725:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783562533.039941:0:19561:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783562533.039945:0:19561:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783562533.040076:0:19561:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bfcf6165800 00000020:01000004:1.0:1783562533.040091:0:19561:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783562533.040103:0:19561:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783562533.040117:0:19561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bfcf7128000) 00000020:00000080:1.0:1783562533.040144:0:19561:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783562533.053824:0:19561:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783562533.054089:0:19561:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783562533.054749:0:19561:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783562533.054956:0:19561:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783562533.055204:0:19561:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1783562533.055718:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:1.0:1783562533.055846:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:1.0:1783562533.055938:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:1.0:1783562533.056542:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1783562533.056812:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1783562533.057079:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1783562533.057329:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1783562533.057791:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1783562533.058039:0:19561:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00000020:00000080:1.0:1783562533.058662:0:19561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783562533.058676:0:19561:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783562533.058687:0:19561:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b89b0b 00000020:01000004:1.0:1783562533.058695:0:19561:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783562533.058719:0:19561:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783562533.058723:0:19561:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783562533.058730:0:19561:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783562533.058756:0:19561:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783562533.058761:0:19561:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783562533.066940:0:19561:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783562533.066978:0:19561:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783562533.066983:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783562533.066985:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562533.066991:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562533.066992:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562533.066993:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562533.066994:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562533.066995:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562533.066997:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562533.066998:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783562533.067002:0:19561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783562533.067004:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783562533.067005:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562533.067006:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562533.067007:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562533.067008:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562533.067009:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562533.067010:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562533.067011:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562533.067012:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783562533.067065:0:19561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783562533.067088:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563670784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783562533.067161:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.067286:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd8f00900 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.067378:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670784 00000100:00100000:0.0:1783562533.067387:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670784 00000100:00100000:0.0:1783562533.067607:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783562533.067619:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:19561:x1870200563670784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783562533.067648:0:18249:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783562533.067652:0:18249:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783562533.067655:0:18249:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783562533.092109:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:19561:x1870200563670784:12345-0@lo:253:mount.lustre.0 Request processed in 24483us (24938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.092125:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783562533.092147:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563670784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783562533.092162:0:19561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783562533.092166:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783562533.092167:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783562533.092169:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783562533.092170:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783562533.092171:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783562533.092173:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783562533.092174:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783562533.092176:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783562533.092178:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783562533.092203:0:19561:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bfcf6165800 from lustre-OST0001 10000000:01000000:1.0:1783562533.092227:0:19561:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783562533.092229:0:19561:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783562533.092234:0:19561:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bfbc6a40000 local copy 00010000:00010000:1.0:1783562533.092243:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562533.092520:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563670912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562533.092610:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.092648:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.092652:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563670912 00000100:00100000:0.0:1783562533.092658:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563670912 00000100:00100000:0.0:1783562533.092707:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783562533.092715:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:19561:x1870200563670912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.092876:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:19561:x1870200563670912:12345-0@lo:501:mount.lustre.0 Request processed in 161us (266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783562533.092885:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783562533.092897:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563670912:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783562533.092909:0:19561:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783562533.093209:0:19561:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783562533.093217:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.093226:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d2400/0x4738ba0933b8989c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b898a3 expref: -99 pid: 18236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783562533.093246:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bfcf6165800 10000000:01000000:1.0:1783562533.093251:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783562533.093256:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783562533.093258:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783562533.093483:0:19561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783562533.093487:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783562533.093518:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.093526:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.093537:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562533.093640:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783562533.093679:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.093702:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.094087:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671040 00000100:00100000:0.0:1783562533.094093:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671040 00000100:00100000:0.0:1783562533.094139:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783562533.094148:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:19561:x1870200563671040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783562533.094161:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562533.094175:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89b12 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.094207:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89b12 expref: 17 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.094218:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698ea00/0x4738ba0933b89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89b12 expref: 17 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.094226:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698ea00, rc 0) 00000100:00100000:0.0:1783562533.094260:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671040:12345-0@lo:101:mount.lustre.0 Request processed in 114us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.094267:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783562533.094373:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562533.094383:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b19 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.094390:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89b19 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783562533.094975:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1783562533.095880:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783562533.096071:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1783562533.096114:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1783562533.096147:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1783562533.096195:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1783562533.096232:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1783562533.096273:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1783562533.096328:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1783562533.096369:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1783562533.096447:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1783562533.096701:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1783562533.096709:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1783562533.096882:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.096952:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.096996:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.097020:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671168 00000100:00100000:3.0:1783562533.097028:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671168 00000100:00100000:3.0:1783562533.097094:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783562533.097104:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783562533.097510:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671168:12345-0@lo:501:mount.lustre.0 Request processed in 407us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.097518:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783562533.097655:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.097698:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562533.097737:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.097819:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.097918:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671296 00000100:00100000:3.0:1783562533.097922:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671296 00000100:00100000:3.0:1783562533.097990:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783562533.097998:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562533.098327:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671296:12345-0@lo:503:mount.lustre.0 Request processed in 329us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.098336:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783562533.098448:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783562533.099119:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783562533.099187:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562533.099230:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.099269:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.099660:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671424 00000100:00100000:3.0:1783562533.099666:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671424 00000100:00100000:3.0:1783562533.099710:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783562533.099717:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562533.099918:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671424:12345-0@lo:502:mount.lustre.0 Request processed in 200us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.099926:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783562533.101509:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562533.101947:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783562533.102005:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1783562533.102127:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1783562533.102174:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1783562533.102207:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1783562533.102235:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1783562533.102277:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1783562533.102309:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1783562533.102355:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1783562533.102394:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783562533.102579:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.102630:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcdf18f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.102853:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671552 00000100:00100000:0.0:1783562533.102862:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671552 00000100:00100000:0.0:1783562533.102914:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783562533.102923:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562533.103120:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671552:12345-0@lo:502:mount.lustre.0 Request processed in 197us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.103137:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783562533.103152:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562533.103215:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1783562533.103223:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1783562533.104235:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783562533.104243:0:19562:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783562533.104248:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.104250:0:19562:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783562533.104253:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783562533.104265:0:19562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bfcf71299c0) 00000020:00000080:1.0:1783562533.104284:0:19562:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783562533.104288:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783562533.104333:0:19562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6165800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783562533.104338:0:19562:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783562533.104343:0:19562:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4738ba0933b89b27 00010000:00010000:1.0:1783562533.107830:0:19562:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783562533.108262:0:19562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:1.0:1783562533.109606:0:19562:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1783562533.110628:0:19562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783562533.110642:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562533.110647:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.110649:0:19562:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783562533.110651:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562533.110654:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.110655:0:19562:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783562533.110657:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783562533.110658:0:19562:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783562533.110660:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562533.110661:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.110662:0:19562:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783562533.110663:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783562533.110664:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.110665:0:19562:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783562533.110667:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783562533.110702:0:19562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783562533.110704:0:19562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783562533.110705:0:19562:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783562533.110706:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1783562533.110845:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783562533.110865:0:19561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783562533.110886:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b19 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.110898:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498000/0x4738ba0933b89b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b19 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562533.110906:0:19561:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6165800 from 1 10000000:01000000:0.0:1783562533.110908:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562533.110943:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.110951:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.110962:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562533.110986:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783562533.111065:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.111110:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783562533.111209:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671680 00000100:00100000:1.0:1783562533.111215:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671680 00000100:00100000:1.0:1783562533.111255:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783562533.111263:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:19561:x1870200563671680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783562533.111278:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562533.111290:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89b2e expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.111311:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.111319:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.111334:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498200, rc 0) 00000100:00100000:1.0:1783562533.111475:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563671680:12345-0@lo:101:mount.lustre.0 Request processed in 211us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562533.111483:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783562533.111585:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783562533.111602:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562533.111612:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562533.113142:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1783562533.113776:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562533.114074:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1783562533.114119:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1783562533.114176:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1783562533.114217:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1783562533.114255:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1783562533.114332:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1783562533.114458:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1783562533.114511:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1783562533.114617:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1783562533.114627:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1783562533.114734:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562533.114808:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562533.114856:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.115204:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671808 00000100:00100000:0.0:1783562533.115215:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671808 00000100:00100000:0.0:1783562533.115289:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783562533.115302:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563671808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.115615:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563671808:12345-0@lo:501:mount.lustre.0 Request processed in 315us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.115634:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783562533.116197:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783562533.116256:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562533.116314:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562533.116365:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.116454:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563671936 00000100:00100000:3.0:1783562533.116461:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563671936 00000100:00100000:3.0:1783562533.116509:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783562533.116528:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563671936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783562533.116876:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563671936:12345-0@lo:503:mount.lustre.0 Request processed in 350us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.116885:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783562533.116921:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563671936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783562533.117880:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783562533.117972:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562533.118032:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562533.118084:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.118233:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672064 00000100:00100000:0.0:1783562533.118240:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672064 00000100:00100000:0.0:1783562533.118281:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783562533.118292:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563672064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562533.118551:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563672064:12345-0@lo:502:mount.lustre.0 Request processed in 261us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.118559:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783562533.118678:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562533.118937:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783562533.118984:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783562533.119034:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783562533.119085:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783562533.119120:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783562533.119177:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783562533.119216:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783562533.119250:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1783562533.119279:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783562533.119325:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562533.119368:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.119440:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672192 00000100:00100000:3.0:1783562533.119448:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672192 00000100:00100000:3.0:1783562533.119484:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783562533.119493:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563672192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562533.119678:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563672192:12345-0@lo:502:mount.lustre.0 Request processed in 185us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.119686:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783562533.119981:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783562533.120107:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783562533.120121:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783562533.123429:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562533.123441:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123443:0:19566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783562533.123449:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6165800 00000020:00000080:2.0:1783562533.123451:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562533.123459:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562533.123461:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123467:0:19566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783562533.123469:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562533.123471:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123472:0:19566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783562533.123474:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bfcf6165800 00000020:00000080:2.0:1783562533.123475:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562533.123531:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562533.123534:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123535:0:19566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783562533.123536:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783562533.123538:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123539:0:19566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783562533.123541:0:19566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bfcf6165800 00000020:00000080:2.0:1783562533.123542:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783562533.123570:0:19566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783562533.123573:0:19566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783562533.123574:0:19566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783562533.123576:0:19566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1783562533.123710:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783562533.123740:0:19561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783562533.123767:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.123777:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783562533.123966:0:19561:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783562533.123969:0:19561:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bfcf6165800 10000000:01000000:3.0:1783562533.123972:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bfcf6165800 10000000:01000000:3.0:1783562533.123975:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783562533.123979:0:19561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bfcf6165800 from 1 10000000:01000000:3.0:1783562533.123980:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783562533.124015:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124021:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124056:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562533.124087:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783562533.124167:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562533.124214:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672320 00000100:00100000:3.0:1783562533.124226:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672320 00000100:00100000:3.0:1783562533.124280:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783562533.124292:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563672320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562533.124310:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562533.124325:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0031c00/0x4738ba0933b89b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89b3c expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124353:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0031c00/0x4738ba0933b89b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89b3c expref: 19 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124366:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0031c00/0x4738ba0933b89b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89b3c expref: 19 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124377:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031c00, rc 0) 00000100:00100000:3.0:1783562533.124462:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672320:12345-0@lo:101:mount.lustre.0 Request processed in 172us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.124467:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783562533.124505:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.124526:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783562533.124537:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b43 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.124551:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89b43 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783562533.125494:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1783562533.126336:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783562533.126850:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783562533.126972:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1783562533.127007:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1783562533.127083:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1783562533.127138:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1783562533.127224:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1783562533.127294:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1783562533.127370:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783562533.127588:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783562533.127642:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783562533.127683:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783562533.127797:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783562533.127882:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783562533.127950:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783562533.128034:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783562533.128093:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783562533.128129:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783562533.128189:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783562533.128236:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783562533.128289:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783562533.128361:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783562533.128431:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783562533.128476:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783562533.128556:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783562533.128592:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1783562533.128632:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1783562533.128705:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1783562533.128762:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1783562533.128833:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1783562533.128922:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1783562533.128980:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1783562533.129018:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1783562533.129065:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1783562533.129134:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1783562533.129187:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1783562533.129237:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1783562533.129293:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1783562533.129350:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1783562533.129627:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1783562533.129681:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1783562533.129813:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1783562533.129821:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1783562533.129945:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.130033:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.130090:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b300 going to sleep for 11 seconds 00000100:00100000:1.0:1783562533.130162:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672448 00000100:00100000:1.0:1783562533.130172:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672448 00000100:00100000:1.0:1783562533.130241:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783562533.130254:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783562533.130701:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672448:12345-0@lo:501:mount.lustre.0 Request processed in 449us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562533.130711:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783562533.130734:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783562533.130775:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783562533.130807:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.130826:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783562533.130904:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672576 00000100:00100000:2.0:1783562533.130911:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672576 00000100:00100000:2.0:1783562533.131667:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783562533.131682:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783562533.132493:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672576:12345-0@lo:503:mount.lustre.0 Request processed in 814us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562533.132503:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783562533.132859:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783562533.134375:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783562533.134536:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783562533.134649:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.134705:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd819b300 going to sleep for 11 seconds 00000100:00100000:3.0:1783562533.134730:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672704 00000100:00100000:3.0:1783562533.134741:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672704 00000100:00100000:3.0:1783562533.134872:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783562533.134884:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562533.135260:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672704:12345-0@lo:502:mount.lustre.0 Request processed in 377us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.135271:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783562533.135630:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783562533.136019:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783562533.136143:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783562533.136605:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783562533.136681:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783562533.136730:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783562533.136782:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783562533.137022:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783562533.137085:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783562533.137137:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783562533.137170:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783562533.137198:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783562533.137242:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783562533.137280:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783562533.137312:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783562533.137447:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783562533.137481:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783562533.137510:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783562533.137563:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783562533.137597:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783562533.137626:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783562533.137671:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783562533.137706:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783562533.137739:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783562533.137788:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783562533.137825:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1783562533.137877:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1783562533.138237:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1783562533.138287:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1783562533.138329:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1783562533.138513:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1783562533.138549:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1783562533.138582:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1783562533.138613:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1783562533.138659:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1783562533.138695:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1783562533.138744:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1783562533.138780:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1783562533.138922:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1783562533.138978:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1783562533.139017:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1783562533.139097:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562533.139186:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562533.139243:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672832 00000100:00100000:3.0:1783562533.139252:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672832 00000100:00100000:3.0:1783562533.139377:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783562533.139387:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783562533.139665:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563672832:12345-0@lo:502:mount.lustre.0 Request processed in 278us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562533.139674:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783562533.142553:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc813e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562533.142602:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563672832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783562533.143093:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1783562533.143111:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783562533.146890:0:19571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783562533.146910:0:19571:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bfcf712b380) 00000020:00000080:1.0:1783562533.146950:0:19571:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1783562533.147146:0:19571:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bfcf6165800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562533.147150:0:19571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bfcf6165800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783562533.147153:0:19571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bfcf6165800 3 00010000:00080000:1.0:1783562533.147189:0:19571:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bfbc7fd6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.104@tcp at head 00010000:00010000:1.0:1783562533.150196:0:19571:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1783562533.150316:0:19571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783562533.150369:0:19571:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783562533.150384:0:19571:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4738ba0933b89b51 00000100:00080000:1.0:1783562533.150496:0:19571:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783562533.150504:0:19571:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bfbc7fd6800 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562533.150548:0:19571:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2d180 x1870200563672960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562533.150620:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563672960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783562533.150702:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783562533.150761:0:19571:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783562533.150807:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562533.150812:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783562533.150814:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562533.150819:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 339 00000100:00080000:1.0:1783562533.150824:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783562533.150828:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcef1dc000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:1.0:1783562533.150842:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2f800 x1870200563673216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562533.150886:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563673216:0@lo:8:kworker.0 00000100:00100000:0.0:1783562533.150915:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.150960:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563672960 00000100:00100000:0.0:1783562533.150968:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563672960 00000100:00100000:0.0:1783562533.151010:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562533.151019:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3271:x1870200563672960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783562533.151056:0:18256:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:0.0:1783562533.151094:0:18256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4738ba0933b89b58 00000004:00100000:0.0:1783562533.151111:0:18256:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783562533.151140:0:18256:0:(import.c:65:import_set_state_nolock()) ffff9bfcd170e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562533.151188:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1870200563672960:12345-0@lo:38:llog_process_th.0 Request processed in 169us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.151195:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783562533.151203:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783562533.151215:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563673088:0@lo:400:kworker.0 00010000:00080000:0.0:1783562533.151243:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2d180 x1870200563672960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783562543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562533.151253:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1783562533.151256:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783562533.151260:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1783562533.151267:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783562533.151272:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783562533.151274:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfbc7fd6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783562533.151281:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3271:1870200563672960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783562533.151510:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673216 00000100:00100000:1.0:1783562533.151514:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673216 00000100:00100000:1.0:1783562533.151593:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673088 00000100:00100000:1.0:1783562533.151597:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673088 00000100:00100000:3.0:1783562533.151603:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783562533.151608:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3271:x1870200563673216:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783562533.151660:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3271:x1870200563673216:12345-0@lo:8:kworker.0 Request processed in 50us (744us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783562533.151667:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783562533.151674:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562533.151682:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563673088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562533.151712:0:3271:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783562533.151717:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783562533.151730:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563673088:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00080000:3.0:1783562533.151732:0:3271:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783562533.151737:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563673216:0@lo:8:kworker.0 00000100:00100000:1.0:1783562533.151737:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783562533.151755:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563673344:0@lo:400:kworker.0 00000100:00100000:1.0:1783562533.151780:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.151799:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783562533.151804:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563673472:0@lo:400:kworker.0 00000100:00100000:1.0:1783562533.151834:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562533.151861:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673344 00000100:00100000:1.0:1783562533.151865:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673344 00000100:00100000:1.0:1783562533.151887:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673472 00000100:00100000:1.0:1783562533.151889:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673472 00000100:00080000:0.0:1783562533.151914:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783562533.151919:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562533.151932:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783562533.152000:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563673344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562533.152056:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1870200563673344:12345-0@lo:400:kworker.0 Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.152064:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783562533.152096:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2dc00 x1870200563673344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562533.152107:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3274:1870200563673344:0@lo:400:kworker.0 00000100:00100000:3.0:1783562533.152114:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1783562533.152126:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563673088:0@lo:400:kworker.0 00000100:00100000:1.0:1783562533.152200:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562533.152207:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563673472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783562533.152244:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1870200563673472:12345-0@lo:400:kworker.0 Request processed in 37us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562533.152250:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783562533.152343:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bfceee2f480 x1870200563673472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783562533.152353:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3274:1870200563673472:0@lo:400:kworker.0 00000040:00080000:1.0:1783562533.152803:0:19571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1783562533.152933:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783562533.153025:0:19561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783562533.153055:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b43 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.153067:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc0030200/0x4738ba0933b89b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b43 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783562533.153121:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783562533.153124:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783562533.153125:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562533.153126:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562533.153127:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562533.153128:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562533.153129:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562533.153131:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562533.153133:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783562533.153137:0:19561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783562533.153140:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783562533.153141:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783562533.153146:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783562533.153147:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783562533.153148:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783562533.153149:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783562533.153149:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783562533.153150:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783562533.153151:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783562533.153176:0:19561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783562533.153193:0:19561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563673600:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783562533.153252:0:19561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.153288:0:19561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc839e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783562533.153300:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673600 00000100:00100000:2.0:1783562533.153307:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673600 00000100:00100000:2.0:1783562533.153458:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783562533.153471:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:19561:x1870200563673600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783562533.153498:0:18249:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783562533.153514:0:18249:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783562533.180332:0:18249:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783562533.180352:0:18249:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783562533.180361:0:18270:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783562533.180367:0:18270:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783562533.180993:0:18270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562533.181017:0:18270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 19 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562533.181027:0:18270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562533.181077:0:18270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 19 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562533.181093:0:18270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 19 pid: 18248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562533.181112:0:18270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563673728:0@lo:104: 00000100:00100000:2.0:1783562533.181206:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562533.181509:0:18270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66a8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562533.182651:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673728 00000100:00100000:0.0:1783562533.182663:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673728 00000100:00100000:1.0:1783562533.182774:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783562533.182786:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563673728:12345-0@lo:104: 00010000:00010000:1.0:1783562533.182805:0:18238:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562533.182969:0:18238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783562533.182976:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:18270:x1870200563673728:12345-0@lo:104: Request processed in 193us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562533.182984:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783562533.183309:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562533.183318:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183339:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6336c00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:0.0:1783562533.183344:0:18243:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183354:0:18243:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783562533.183362:0:18243:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562533.183368:0:18243:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783562533.183437:0:18243:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183460:0:18243:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783562533.183481:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183488:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf6336c00/0x4738ba0933b89a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89a1d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183508:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562533.183510:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562533.183512:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562533.183529:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563673856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783562533.183573:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562533.183642:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673856 00000100:00100000:0.0:1783562533.183647:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673856 00010000:00010000:0.0:1783562533.183670:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 20 pid: 18248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562533.183693:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562533.183699:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+20:3272:x1870200563673856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783562533.183711:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562533.183716:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 20 pid: 18248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183727:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 20 pid: 18248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183746:0:18240:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183764:0:18240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783562533.183781:0:18240:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003413719s 00010000:00010000:0.0:1783562533.183785:0:18240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183793:0:18240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183801:0:18240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183807:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183813:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562533.183817:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183825:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183834:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562533.183845:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562533.183874:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+20:3272:x1870200563673856:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.183881:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783562533.183930:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563673856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783562533.185718:0:18270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b89a16 expref: 19 pid: 18248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562533.185763:0:18270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18270:1870200563673728:0@lo:104: 00010000:00010000:3.0:1783562533.185795:0:18270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.185807:0:18270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.185814:0:18270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562533.185821:0:18270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89b5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562533.191052:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:19561:x1870200563673600:12345-0@lo:253:mount.lustre.0 Request processed in 37567us (37781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562533.191067:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783562533.191169:0:19561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:985d615a-b40a-4e93-ba73-7a6a65910c9a:19561:1870200563673600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783562533.191183:0:19561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783562533.191185:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783562533.191186:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783562533.191187:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783562533.191188:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783562533.191188:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783562533.191189:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783562533.191191:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783562533.191192:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783562533.191193:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783562533.191204:0:19561:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783562533.191685:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562533.191851:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562533.192173:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562533.192344:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783562533.192523:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783562533.192787:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783562533.193566:0:19561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1783562533.241066:0:19561:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783562533.241079:0:19561:0:(lfsck_lib.c:3088:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783562533.241122:0:19561:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783562533.241180:0:19561:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783562533.241324:0:19561:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783562533.241358:0:19561:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1783562533.944827:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783562534.710873:0:18251:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783562534.710883:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bfbc1e07800 from 11 10000000:01000000:2.0:1783562534.710889:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783562534.711119:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562534.711133:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562534.711145:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562534.711176:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563673984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783562534.711270:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562534.711330:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd14faa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783562534.711460:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563673984 00000100:00100000:3.0:1783562534.711470:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563673984 00000100:00100000:3.0:1783562534.712205:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783562534.712222:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563673984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783562534.712240:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562534.712264:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89b66 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562534.712297:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89b66 expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562534.712318:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0031200/0x4738ba0933b89b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89b66 expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562534.712328:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031200, rc 0) 00000100:00100000:3.0:1783562534.712439:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563673984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562534.712446:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783562534.712557:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563673984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562534.712576:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b6d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562534.712585:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89b6d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562534.712657:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563674112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783562534.712705:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562534.712923:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcca2fa240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562534.712955:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674112 00000100:00100000:1.0:1783562534.712962:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674112 00000100:00100000:1.0:1783562534.712995:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783562534.713003:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563674112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783562534.713034:0:18248:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783562534.713057:0:18248:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783562534.713060:0:18248:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1783562534.713168:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563674112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562534.713183:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783562534.713221:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563674112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783562534.713293:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783562534.713301:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b6d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562534.713310:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcf6683000/0x4738ba0933b89b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89b6d expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562534.967139:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562535.798902:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562535.798934:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcefb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563674240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783562535.799027:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562535.799107:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674240 00000100:00100000:0.0:1783562535.799115:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674240 00000100:00100000:0.0:1783562535.799174:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783562535.799185:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563674240:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783562535.799194:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783562535.799226:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562535.799281:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563674240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562535.799288:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783562535.799672:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcefb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563674240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783562535.995203:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562536.817124:0:19912:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783562537.015187:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.038572:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562538.191922:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562538.192037:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225856 00000100:00100000:1.0:1783562538.192058:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225856 00000100:00100000:0.0:1783562538.192213:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:0.0:1783562538.192223:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1870200553225856:12345-192.168.204.4@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783562538.192257:0:18248:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0790a268-b732-4464-ac35-a4cbdd6283cf@192.168.204.4@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1783562538.192291:0:18248:0:(genops.c:1406:class_connect()) connect: client 0790a268-b732-4464-ac35-a4cbdd6283cf, cookie 0x4738ba0933b89b74 00000100:00080000:0.0:1783562538.192454:0:18248:0:(import.c:65:import_set_state_nolock()) ffff9bfcc7e34000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562538.192544:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+5:2360:x1870200553225856:12345-192.168.204.4@tcp:250:mount.lustre.0 Request processed in 321us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.192553:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:2.0:1783562538.197069:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.197292:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553225984 00000100:00100000:0.0:1783562538.197307:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553225984 00000100:00100000:0.0:1783562538.197611:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:0.0:1783562538.197696:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+5:16735:x1870200553225984:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562538.197721:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562538.197754:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21804 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.197788:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21804 expref: 6 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.197802:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698e200/0x4738ba0933b89b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21804 expref: 6 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.197813:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698e200, rc 0) 00000100:00100000:0.0:1783562538.197971:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+6:16735:x1870200553225984:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 350us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.197979:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:1.0:1783562538.199632:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.199726:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226112 00000100:00100000:0.0:1783562538.199735:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226112 00000100:00100000:3.0:1783562538.199825:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:3.0:1783562538.199838:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+6:16735:x1870200553226112:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783562538.200135:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+6:16735:x1870200553226112:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 298us (515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783562538.200143:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:2.0:1783562538.203660:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.203767:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226240 00000100:00100000:0.0:1783562538.203776:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226240 00000100:00100000:0.0:1783562538.203877:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:0.0:1783562538.203888:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+6:16735:x1870200553226240:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562538.203910:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562538.203930:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2180b expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.203973:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2180b expref: 7 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.203986:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf698ee00/0x4738ba0933b89b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2180b expref: 7 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.203996:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf698ee00, rc 0) 00000100:00100000:0.0:1783562538.204064:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+7:16735:x1870200553226240:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 176us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.204072:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:2.0:1783562538.208072:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.208179:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226368 00000100:00100000:3.0:1783562538.208202:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226368 00000100:00100000:0.0:1783562538.208456:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:0.0:1783562538.208469:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+7:16735:x1870200553226368:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562538.208878:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16735:x1870200553226368:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 410us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.208887:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:1.0:1783562538.210901:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.211026:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226496 00000100:00100000:0.0:1783562538.211036:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226496 00000100:00100000:0.0:1783562538.211113:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:0.0:1783562538.211131:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16735:x1870200553226496:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783562538.211319:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16735:x1870200553226496:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.211327:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:2.0:1783562538.213487:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.213553:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226624 00000100:00100000:3.0:1783562538.213561:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226624 00000100:00100000:3.0:1783562538.213602:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:3.0:1783562538.213610:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16753:x1870200553226624:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783562538.213859:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16753:x1870200553226624:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 248us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.213867:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:2.0:1783562538.221729:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.221798:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226752 00000100:00100000:0.0:1783562538.221808:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226752 00000100:00100000:0.0:1783562538.221864:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:0.0:1783562538.221875:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16753:x1870200553226752:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562538.222182:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16753:x1870200553226752:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 308us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.222192:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:1.0:1783562538.225775:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562538.226488:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553226880 00000100:00100000:2.0:1783562538.226503:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553226880 00000100:00100000:2.0:1783562538.226557:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:2.0:1783562538.226567:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+8:16735:x1870200553226880:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783562538.226598:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562538.226616:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683a00/0x4738ba0933b89b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21835 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.226644:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683a00/0x4738ba0933b89b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21835 expref: 9 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.226657:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683a00/0x4738ba0933b89b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21835 expref: 9 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.226666:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683a00, rc 0) 00000100:00100000:2.0:1783562538.226729:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+9:16735:x1870200553226880:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 163us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.226736:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:2.0:1783562538.232016:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.232585:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227008 00000100:00100000:0.0:1783562538.232598:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227008 00000100:00100000:0.0:1783562538.232658:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:0.0:1783562538.232668:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+9:16735:x1870200553227008:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783562538.232794:0:18249:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783562538.232819:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783562538.232823:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783562538.232826:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783562538.232828:0:18249:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1783562538.236503:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+9:16735:x1870200553227008:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 3824us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.236519:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:1.0:1783562538.239558:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.239625:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227136 00000100:00100000:3.0:1783562538.239648:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227136 00000100:00100000:3.0:1783562538.239704:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:3.0:1783562538.239714:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+9:16735:x1870200553227136:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783562538.239729:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562538.239746:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2183c expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.239773:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 10 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.239781:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 10 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.239788:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030c00, rc 0) 00000100:00100000:3.0:1783562538.239834:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16735:x1870200553227136:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.239840:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:2.0:1783562538.243810:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.244001:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227264 00000100:00100000:0.0:1783562538.244011:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227264 00000100:00100000:0.0:1783562538.244062:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:0.0:1783562538.244082:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16735:x1870200553227264:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783562538.244345:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16735:x1870200553227264:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 263us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.244353:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:1.0:1783562538.245942:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.246093:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227392 00000100:00100000:3.0:1783562538.246100:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227392 00000100:00100000:3.0:1783562538.246143:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:3.0:1783562538.246151:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16735:x1870200553227392:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783562538.246360:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16735:x1870200553227392:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 208us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.246369:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:1.0:1783562538.248539:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562538.248651:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227520 00000100:00100000:2.0:1783562538.248661:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227520 00000100:00100000:2.0:1783562538.248720:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:2.0:1783562538.248729:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16758:x1870200553227520:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562538.249044:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16758:x1870200553227520:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 315us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.249052:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:2.0:1783562538.251292:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.251399:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227648 00000100:00100000:3.0:1783562538.251497:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227648 00000100:00100000:3.0:1783562538.251591:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:3.0:1783562538.251603:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16758:x1870200553227648:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783562538.252005:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16758:x1870200553227648:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 403us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.252014:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:1.0:1783562538.259137:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562538.259252:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562538.259361:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228160 00000100:00100000:2.0:1783562538.259372:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228160 00000100:00100000:2.0:1783562538.259614:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:2.0:1783562538.259642:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+10:2362:x1870200553228160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562538.259738:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+10:2362:x1870200553228160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 98us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.259751:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:0.0:1783562538.259826:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227776 00000100:00100000:0.0:1783562538.259830:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227776 00000100:00100000:0.0:1783562538.259860:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:0.0:1783562538.259866:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1870200553227776:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783562538.259895:0:18256:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848@192.168.204.4@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1783562538.259982:0:18256:0:(genops.c:1406:class_connect()) connect: client f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848, cookie 0x4738ba0933b89b97 00000004:00100000:0.0:1783562538.260026:0:18256:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1783562538.260034:0:18256:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1783562538.288494:0:18256:0:(import.c:65:import_set_state_nolock()) ffff9bfbc7fd3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783562538.288603:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2360:x1870200553227776:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 28733us (29475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562538.288617:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562538.291500:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562538.291543:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562538.291623:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228032 00000100:00100000:2.0:1783562538.291634:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228032 00000100:00080000:1.0:1783562538.291693:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562538.291710:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553227904 00000100:00100000:2.0:1783562538.291714:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553227904 00000100:00100000:2.0:1783562538.291736:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562538.291745:0:18256:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783562538.291748:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:16735:x1870200553228032:12345-192.168.204.4@tcp:41:mount.lustre.0 00000100:00100000:3.0:1783562538.291760:0:18256:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00000024:2.0:1783562538.291800:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783562538.291895:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:16735:x1870200553228032:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.291904:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:2.0:1783562538.291921:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562538.291928:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:0:x1870200553227904:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783562538.291938:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783562538.291973:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:0:x1870200553227904:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.291980:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:3.0:1783562538.293468:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.293610:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228288 00000100:00100000:0.0:1783562538.293618:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228288 00000100:00100000:1.0:1783562538.293875:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1783562538.293884:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16735:x1870200553228288:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783562538.293986:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16735:x1870200553228288:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 102us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562538.293994:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:3.0:1783562538.295922:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.295972:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.296043:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228416 00000100:00100000:0.0:1783562538.296052:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228416 00000100:00100000:0.0:1783562538.296211:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228544 00000100:00100000:0.0:1783562538.296215:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228544 00000100:00100000:3.0:1783562538.296307:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562538.296630:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562538.296639:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870200553228416:12345-192.168.204.4@tcp:8:mount.lustre.0 00000100:00100000:3.0:1783562538.296646:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:3.0:1783562538.296651:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870200553228544:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783562538.296672:0:18890:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848@192.168.204.4@tcp t0 exp 0000000000000000 cur 347 last 0 00010000:00080000:3.0:1783562538.296711:0:18889:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848@192.168.204.4@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1783562538.296724:0:18890:0:(genops.c:1406:class_connect()) connect: client f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848, cookie 0x4738ba0933b89b9e 00000020:00000080:3.0:1783562538.296730:0:18889:0:(genops.c:1406:class_connect()) connect: client f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848, cookie 0x4738ba0933b89ba5 00002000:00100000:3.0:1783562538.296739:0:18889:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848/ffff9bfbc1da7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562538.296739:0:18890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848/ffff9bfd00daf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783562538.296768:0:18890:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1783562538.296837:0:18889:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783562538.297194:0:18890:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783562538.297235:0:18890:0:(import.c:65:import_set_state_nolock()) ffff9bfd00dac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783562538.297323:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2360:x1870200553228416:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 683us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.297331:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562538.297379:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228672 00000100:00100000:0.0:1783562538.297385:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228672 00000100:00100000:0.0:1783562538.297444:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:0.0:1783562538.297451:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16735:x1870200553228672:12345-192.168.204.4@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783562538.298147:0:18257:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 638us 00002000:00080000:3.0:1783562538.299065:0:18889:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783562538.299104:0:18889:0:(import.c:65:import_set_state_nolock()) ffff9bfbc1da2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783562538.299245:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2360:x1870200553228544:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 2588us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.299256:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000004:00200000:2.0:1783562538.310765:0:18257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783562538.310930:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16735:x1870200553228672:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 13472us (14616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.310957:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00080000:1.0:1783562538.358729:0:18618:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783562538.358736:0:18618:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783562538.358740:0:18618:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783562538.358754:0:18618:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bfcef1dc000 using connection 192.168.204.104@tcp/0@lo 00000100:00100000:0.0:1783562538.358757:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563674368:0@lo:400:kworker.0 00000100:00100000:1.0:1783562538.358795:0:18618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bfceee2dc00 x1870200563674624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783562538.358842:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562538.358888:0:3271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563674624:0@lo:8:kworker.0 00000100:00100000:0.0:1783562538.358914:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563675008:0@lo:400:kworker.0 00000100:00100000:3.0:1783562538.358935:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562538.358968:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562538.358997:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674624 00000100:00100000:0.0:1783562538.358999:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783562538.359006:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674624 00000100:00100000:0.0:1783562538.359007:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563674496:0@lo:400:kworker.0 00000100:00100000:0.0:1783562538.359040:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562538.359050:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563674752:0@lo:400:kworker.0 00000100:00100000:3.0:1783562538.359056:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674496 00000100:00100000:2.0:1783562538.359060:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563674880:0@lo:400:kworker.0 00000100:00100000:3.0:1783562538.359078:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674496 00000100:00100000:0.0:1783562538.359091:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562538.359096:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562538.359105:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3271:x1870200563674624:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783562538.359129:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783562538.359141:0:18890:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 347 last 0 00000100:00100000:3.0:1783562538.359151:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562538.359164:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563674496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562538.359165:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675008 00000100:00100000:2.0:1783562538.359172:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675008 00000020:00000080:0.0:1783562538.359179:0:18890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4738ba0933b89bac 00002000:00100000:0.0:1783562538.359204:0:18890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bfd00dac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783562538.359210:0:18890:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783562538.359213:0:18890:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783562538.359220:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674752 00000100:00100000:2.0:1783562538.359225:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674752 00000100:00100000:3.0:1783562538.359228:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563674496:12345-0@lo:400:kworker.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.359237:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562538.359245:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674880 00000100:00100000:2.0:1783562538.359249:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674880 00000100:00080000:3.0:1783562538.359262:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783562538.359268:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783562538.359271:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562538.359280:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563675008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562538.359311:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783562538.359324:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563674752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562538.359324:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563675008:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.359338:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562538.359358:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562538.359367:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563674880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562538.359378:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563674752:12345-0@lo:400:kworker.0 Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.359384:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783562538.359445:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfceee2f800 x1870200563674752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562538.359460:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563674752:0@lo:400:kworker.0 00002000:00080000:0.0:1783562538.359555:0:18890:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783562538.359580:0:18890:0:(import.c:65:import_set_state_nolock()) ffff9bfd00da8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562538.359636:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563674880:12345-0@lo:400:kworker.0 Request processed in 271us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.359644:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562538.359697:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563674496:0@lo:400:kworker.0 00010000:00080000:2.0:1783562538.359712:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfceee2e680 x1870200563675008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783562538.359721:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563675008:0@lo:400:kworker.0 00000100:00100000:2.0:1783562538.359750:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563674368 00000100:00100000:2.0:1783562538.359754:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563674368 00000100:00100000:2.0:1783562538.359781:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783562538.359788:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3274:x1870200563674368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562538.359824:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3274:x1870200563674368:12345-0@lo:400:kworker.0 Request processed in 36us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562538.359836:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783562538.359868:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563674368:0@lo:400:kworker.0 00010000:00080000:3.0:1783562538.360318:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfceee2d180 x1870200563674880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783562554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562538.360330:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563674880:0@lo:400:kworker.0 00000100:00100000:0.0:1783562538.360858:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3271:x1870200563674624:12345-0@lo:8:kworker.0 Request processed in 1751us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.360872:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783562538.360976:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfceee2dc00 x1870200563674624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783562558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783562538.360991:0:3271:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783562538.361000:0:3271:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783562538.361005:0:3271:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783562538.361009:0:3271:0:(import.c:65:import_set_state_nolock()) ffff9bfcef1dc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783562538.361033:0:3271:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783562538.361041:0:3271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3271:1870200563674624:0@lo:8:kworker.0 00000004:00080000:3.0:1783562538.361067:0:18278:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783562538.361435:0:18279:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000004:00080000:3.0:1783562538.361444:0:18278:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347618039940ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783562538.361461:0:18279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18279:1870200563675264:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783562538.361512:0:18279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562538.361535:0:18279:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562538.361554:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675264 00000100:00100000:2.0:1783562538.361559:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675264 00000100:00100000:2.0:1783562538.361915:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562538.361928:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18279:x1870200563675264:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783562538.361983:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563675136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562538.362018:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562538.362064:0:18893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675136 00000100:00100000:3.0:1783562538.362069:0:18893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675136 00000100:00100000:3.0:1783562538.362103:0:18893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562538.362111:0:18893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563675136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783562538.362126:0:18893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783562538.362172:0:18893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1870200563675136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.362180:0:18893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783562538.362213:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bfcef1aa680 x1870200563675136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783562554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783562538.362230:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563675136:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783562538.362267:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1783562538.367193:0:18891:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783562538.367205:0:18891:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1783562538.367211:0:18891:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:1.0:1783562538.382211:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.382226:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.382246:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.382251:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.382258:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.382278:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.382313:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.382321:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.382341:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783562538.382984:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.382992:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383002:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.383005:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.383010:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383020:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383029:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383038:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383069:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783562538.383500:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783562538.383510:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.383522:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562538.383528:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562538.383611:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.383618:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383619:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562538.383629:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.383632:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.383636:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383645:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383653:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383661:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.383675:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.383837:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383847:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.383852:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383863:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383887:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383895:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068591cb3/0x4738ba0933b89bba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383918:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.383922:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383942:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.383956:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383967:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383979:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.383987:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089fa2a8f/0x4738ba0933b89bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.384335:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.384355:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.384364:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff76f5e/0x4738ba0933b89bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562538.385628:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.385643:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.385657:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.385669:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.385675:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.385689:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.385699:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.385707:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.385720:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562538.385846:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562538.385854:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.385863:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562538.385868:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.385877:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.385907:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.385916:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d63029e8/0x4738ba0933b89bc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.385962:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.385964:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.385967:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.385997:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783562538.386630:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.386639:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.386651:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.386654:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.386660:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.386672:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.386681:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.386696:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.386717:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562538.387237:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562538.387245:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.387261:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562538.387266:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.387275:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.387291:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.387298:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001662a13e/0x4738ba0933b89bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.387318:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.387320:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.387322:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783562538.387704:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.387714:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.387724:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.387727:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.387732:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.387742:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.387751:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.387758:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.387775:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783562538.388042:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562538.388054:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.388073:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562538.388077:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.388107:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.388125:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.388133:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007fd92f2/0x4738ba0933b89bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.388156:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.388159:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.388162:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.388605:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783562538.388607:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.388610:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.388614:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562538.388616:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.388633:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.388636:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.388640:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.388649:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.388657:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.388664:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.388680:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783562538.389619:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.389630:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.389644:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.389648:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.389653:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.389665:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.389688:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.389695:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.389712:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783562538.390539:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783562538.390549:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.390561:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1783562538.390565:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562538.390570:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.390583:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.390593:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.390601:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.390631:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783562538.390861:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783562538.390870:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.390880:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562538.390885:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.390896:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.390922:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.390930:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f2ff9da/0x4738ba0933b89bdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.391346:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562538.391357:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.391367:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.391572:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.391586:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.391604:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.391612:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000347ddf84/0x4738ba0933b89be4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.391777:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783562538.391912:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.391916:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.391918:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.391939:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.391961:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.391972:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.391976:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.391998:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392013:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392022:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f193ffdd/0x4738ba0933b89beb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392044:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.392047:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.392050:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.392056:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.392060:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.392506:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.392508:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.392510:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.392739:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.392748:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392764:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.392770:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.392778:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392792:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392814:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392823:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392844:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.392858:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.392864:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392872:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.392877:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392886:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392902:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392910:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f81a3a/0x4738ba0933b89bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.392933:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.392942:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.393032:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.395324:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.395338:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.395356:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.395361:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.395368:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.395983:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.395995:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396003:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396021:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.396035:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.396041:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396049:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698f600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.396053:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396077:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396094:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396101:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086195a71/0x4738ba0933b89bf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.396120:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.396122:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.396124:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.398686:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.398700:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.398715:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.398720:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.398726:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.398742:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.398752:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.398767:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.398786:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562538.399230:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.399237:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399247:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.399250:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.399254:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399263:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399271:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399277:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399295:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783562538.399311:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562538.399317:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399331:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.399335:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399345:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399362:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399369:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4cc4537/0x4738ba0933b89c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399388:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.399391:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399397:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698fc00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.399429:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399439:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399449:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399464:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045002023/0x4738ba0933b89c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399478:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.399480:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.399482:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.399489:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.399896:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.399904:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399913:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.399916:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.399921:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399930:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399938:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399957:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399973:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.399987:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.399992:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.399999:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.400001:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400010:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400021:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400028:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f81ef83/0x4738ba0933b89c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400041:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.400042:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.400044:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.400471:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.400478:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400487:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.400490:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.400494:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400515:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400524:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400532:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400548:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.400558:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.400563:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400571:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.400575:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400583:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400594:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400601:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240e296f/0x4738ba0933b89c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.400627:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.400630:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.400633:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.401330:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.401338:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.401349:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.401353:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.401358:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.401383:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.401394:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.401429:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.401454:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562538.401522:0:19339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.401531:0:19339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.401542:0:19339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.401546:0:19339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.401557:0:19339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.401573:0:19339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.401581:0:19339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022061492/0x4738ba0933b89c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.401601:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.401603:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.401606:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.402051:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.402059:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402081:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.402085:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.402089:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402099:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402108:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402115:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402132:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.402143:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.402149:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402158:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.402163:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402172:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402197:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402205:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006331b608/0x4738ba0933b89c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402219:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.402221:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.402223:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.402865:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.402873:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402883:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.402886:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.402891:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402901:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402910:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402917:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402959:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.402971:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.402975:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402983:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.402987:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.402996:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403011:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403018:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be26eb9/0x4738ba0933b89c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403035:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.403037:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.403039:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.403604:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.403611:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403619:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.403748:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.403752:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403763:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403772:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403779:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.403804:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:3.0:1783562538.404020:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848 00000004:00080000:3.0:1783562538.404038:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1783562538.404260:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.404266:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404276:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.404279:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.404283:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404292:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404300:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404314:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404335:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783562538.404973:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.404982:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.404992:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.404995:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.404998:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405009:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405016:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405024:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405043:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783562538.405057:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783562538.405063:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405077:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.405081:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405090:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405107:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405114:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e515fb/0x4738ba0933b89c31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405135:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783562538.405139:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405145:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.405148:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405154:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405164:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405177:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a2ce80/0x4738ba0933b89c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405190:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.405193:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405200:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9600 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.405203:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405211:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405220:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405228:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c7e52d/0x4738ba0933b89c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.405240:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.405242:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.405244:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.405513:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.405983:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.405990:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406009:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.406012:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.406018:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406029:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406038:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406045:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406112:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562538.406598:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.406605:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406614:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.406616:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.406934:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406959:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406979:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.406986:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407046:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562538.407055:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407069:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.407074:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407082:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407099:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407107:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043576ce/0x4738ba0933b89c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407131:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.407135:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407142:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.407145:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407152:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407162:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.407191:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.407193:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.407195:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.408514:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783562538.408529:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c290b75d/0x4738ba0933b89c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.408586:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.409183:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.409193:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409207:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.409212:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.409218:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409232:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409242:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409263:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409289:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562538.409543:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.409552:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.409562:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.409569:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.409579:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.409599:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.409608:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb541745/0x4738ba0933b89c54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.409712:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.409714:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783562538.409715:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.409718:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.409723:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409734:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.409736:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.409740:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409749:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409756:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409763:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.409785:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562538.409975:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.409982:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410000:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.410004:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410012:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410023:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410030:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d61ffd1/0x4738ba0933b89c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410049:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.410051:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.410053:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.410180:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.410186:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410199:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.410202:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.410207:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410218:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410226:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410234:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410243:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783562538.410673:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.410681:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410690:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.410694:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.410698:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410709:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410728:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410735:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.410763:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783562538.410854:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562538.410863:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410872:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.410875:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410882:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410898:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410905:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419b1409/0x4738ba0933b89c62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410928:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.410932:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410939:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.410943:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410961:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410974:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410981:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8acb7f9/0x4738ba0933b89c69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.410994:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.410996:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.411002:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.411206:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.411212:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.411221:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.411223:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.411227:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.411236:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.411244:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.411252:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.411283:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562538.411315:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562538.411322:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.411331:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb8400 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562538.411335:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.411345:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.411521:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.411530:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a16c5/0x4738ba0933b89c70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.411551:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562538.411553:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562538.411555:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.412339:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783562538.412346:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.412995:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.413008:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.413024:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.413028:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.413034:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.413047:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.413057:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.413064:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.413300:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783562538.413505:0:18242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562538.413513:0:18242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.413522:0:18242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc5cb9800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562538.413528:0:18242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.413537:0:18242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.413556:0:18242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.413564:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a6062e/0x4738ba0933b89c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562538.413595:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.413597:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562538.413600:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.414178:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.414186:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414197:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.414206:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.414212:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414225:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414234:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414241:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414258:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783562538.414269:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783562538.414274:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414282:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517cc00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562538.414286:0:20030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414294:0:20030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783562538.414296:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848 00010000:00010000:0.0:1783562538.414310:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414326:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085d176ab/0x4738ba0933b89c7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414342:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.414343:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562538.414345:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783562538.414894:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783562538.414901:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414911:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1783562538.414914:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562538.414919:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414929:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414938:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414957:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562538.414972:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783562538.415152:0:18891:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:0.0:1783562538.415272:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18279:x1870200563675264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 53344us (53756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562538.415284:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562538.415483:0:18279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18279:1870200563675264:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783562538.415501:0:18279:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:3.0:1783562538.415565:0:18279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18279:1870200563675392:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783562538.415609:0:18279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562538.415660:0:18279:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfbc22c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783562538.415830:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675392 00000100:00100000:0.0:1783562538.415837:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675392 00000100:00100000:0.0:1783562538.415929:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783562538.415941:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18279:x1870200563675392:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783562538.415992:0:18889:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:1.0:1783562538.416125:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562538.416134:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.416160:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517da00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562538.416166:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.416178:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.416196:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.416204:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef81da74/0x4738ba0933b89c85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562538.416225:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562538.416227:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562538.416230:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562538.419647:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18279:x1870200563675392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3700us (4030us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1783562538.419664:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783562538.419722:0:18279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef9af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18279:1870200563675392:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783562538.419740:0:18279:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1783562538.434152:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562538.434264:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228800 00000100:00100000:3.0:1783562538.434277:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228800 00000100:00100000:3.0:1783562538.434383:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:3.0:1783562538.434433:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:16779:x1870200553228800:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:3.0:1783562538.434562:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562538.434597:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031000/0x4738ba0933b89c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21866 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.434682:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.434699:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.434721:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562538.434990:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783562538.434995:0:20028:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562538.435105:0:20028:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.435138:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031000/0x4738ba0933b89c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21866 expref: 7 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.435159:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21866 expref: 6 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562538.435169:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:3.0:1783562538.435172:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562538.435176:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031800, rc 0) 00000100:00100000:3.0:1783562538.435317:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16779:x1870200553228800:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 887us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562538.435336:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:3.0:1783562539.062705:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562540.013289:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562540.016138:0:18893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553228928 00000100:00100000:1.0:1783562540.016161:0:18893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553228928 00000100:00100000:1.0:1783562540.016280:0:18893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:1.0:1783562540.016294:0:18893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16831:x1870200553228928:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:1.0:1783562540.016353:0:18893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562540.016515:0:18893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:16831:x1870200553228928:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 224us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562540.016524:0:18893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00080000:3.0:1783562540.016650:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783562540.020138:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562540.020268:0:18893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229056 00000100:00100000:1.0:1783562540.020302:0:18893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229056 00000100:00100000:1.0:1783562540.020443:0:18893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562540.020455:0:18893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:16831:x1870200553229056:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:1.0:1783562540.020506:0:18893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783562540.020620:0:18893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:16831:x1870200553229056:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 167us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562540.020629:0:18893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00080000:3.0:1783562540.024181:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783562540.087361:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562540.120201:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.120306:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229184 00000100:00100000:0.0:1783562540.120324:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229184 00000100:00100000:0.0:1783562540.120447:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:0.0:1783562540.120464:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+10:16863:x1870200553229184:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783562540.120488:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562540.120512:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc517c400/0x4738ba0933b89c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2186d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562540.120549:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc517c400/0x4738ba0933b89c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2186d expref: 11 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562540.120564:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc517c400/0x4738ba0933b89c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2186d expref: 11 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562540.120575:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517c400, rc 0) 00000100:00100000:0.0:1783562540.120682:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229184:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 224us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.120690:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:2.0:1783562540.123481:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.123594:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229312 00000100:00100000:3.0:1783562540.123608:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229312 00000100:00100000:3.0:1783562540.123709:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:3.0:1783562540.123722:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229312:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783562540.124247:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229312:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 524us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562540.124257:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:1.0:1783562540.125849:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.126002:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229440 00000100:00100000:0.0:1783562540.126015:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229440 00000100:00100000:0.0:1783562540.126089:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:0.0:1783562540.126104:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229440:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783562540.126578:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229440:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 475us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.126588:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:2.0:1783562540.131804:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.131964:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229568 00000100:00100000:3.0:1783562540.131975:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229568 00000100:00100000:3.0:1783562540.132066:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:3.0:1783562540.132077:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16870:x1870200553229568:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783562540.132487:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16870:x1870200553229568:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 410us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562540.132495:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:2.0:1783562540.141780:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.141891:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229696 00000100:00100000:0.0:1783562540.141901:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229696 00000100:00100000:0.0:1783562540.142008:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:0.0:1783562540.142019:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16870:x1870200553229696:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783562540.142338:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16870:x1870200553229696:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 321us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.142347:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:1.0:1783562540.150773:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.152850:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229824 00000100:00100000:3.0:1783562540.152864:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229824 00000100:00100000:3.0:1783562540.153008:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:3.0:1783562540.153135:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16863:x1870200553229824:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783562540.153155:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562540.153175:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b89ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21897 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562540.153219:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b89ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21897 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562540.153232:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc0031000/0x4738ba0933b89ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21897 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562540.153242:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031000, rc 0) 00000100:00100000:3.0:1783562540.153310:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16863:x1870200553229824:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 294us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562540.153317:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:3.0:1783562540.158044:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.158207:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553229952 00000100:00100000:0.0:1783562540.158217:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553229952 00000100:00100000:0.0:1783562540.158275:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:0.0:1783562540.158286:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16863:x1870200553229952:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783562540.158312:0:18249:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783562540.158338:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783562540.158342:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783562540.158345:0:18249:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783562540.158347:0:18249:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1783562540.163212:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16863:x1870200553229952:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 4914us (5163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.163241:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:1.0:1783562540.167247:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562540.169128:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230080 00000100:00100000:2.0:1783562540.169143:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230080 00000100:00100000:2.0:1783562540.169212:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:2.0:1783562540.169222:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16863:x1870200553230080:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783562540.169238:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562540.169260:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2189e expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562540.169301:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562540.169313:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 13 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562540.169323:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683400, rc 0) 00000100:00100000:2.0:1783562540.169472:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16863:x1870200553230080:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 250us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.169480:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:3.0:1783562540.171750:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562540.173552:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230208 00000100:00100000:2.0:1783562540.173568:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230208 00000100:00100000:2.0:1783562540.173700:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:2.0:1783562540.173711:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16863:x1870200553230208:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783562540.174030:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16863:x1870200553230208:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 320us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.174039:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:0.0:1783562540.182152:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562540.182852:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230336 00000100:00100000:2.0:1783562540.182864:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230336 00000100:00100000:2.0:1783562540.182935:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:2.0:1783562540.182946:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16863:x1870200553230336:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783562540.183263:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16863:x1870200553230336:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 317us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.183272:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:1.0:1783562540.189518:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562540.190035:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230464 00000100:00100000:2.0:1783562540.190099:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230464 00000100:00100000:2.0:1783562540.190208:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:2.0:1783562540.190221:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16875:x1870200553230464:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783562540.190607:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16875:x1870200553230464:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 388us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.190616:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:0.0:1783562540.194044:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.194127:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230592 00000100:00100000:3.0:1783562540.194138:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230592 00000100:00100000:3.0:1783562540.194195:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:3.0:1783562540.194205:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16875:x1870200553230592:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783562540.194621:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16875:x1870200553230592:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 415us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562540.194630:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:0.0:1783562540.198367:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562540.198887:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230720 00000100:00100000:2.0:1783562540.198901:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230720 00000100:00100000:2.0:1783562540.198965:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:2.0:1783562540.198975:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1870200553230720:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783562540.199013:0:18254:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e31afcae-9644-4783-bdb1-165e2dd15acb@192.168.204.4@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1783562540.199059:0:18254:0:(genops.c:1406:class_connect()) connect: client e31afcae-9644-4783-bdb1-165e2dd15acb, cookie 0x4738ba0933b89caf 00000004:00100000:2.0:1783562540.199098:0:18254:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783562540.199377:0:18254:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3ae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562540.199629:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+6:2360:x1870200553230720:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 652us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.199638:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562540.200284:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.200344:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230976 00000100:00100000:0.0:1783562540.200352:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230976 00000100:00100000:0.0:1783562540.200440:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562540.200451:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2364:x1870200553230976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1783562540.200552:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783562540.200699:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2364:x1870200553230976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 249us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.200707:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:3.0:1783562540.202064:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.202097:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.202159:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231104 00000100:00100000:0.0:1783562540.202169:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231104 00000100:00100000:0.0:1783562540.202219:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553230848 00000100:00100000:0.0:1783562540.202221:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553230848 00000100:00100000:0.0:1783562540.202235:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1783562540.202241:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+7:16863:x1870200553231104:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783562540.202280:0:18255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783562540.202341:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+7:16863:x1870200553231104:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 99us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.202348:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1783562540.202366:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:0.0:1783562540.202378:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:0:x1870200553230848:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783562540.202388:0:18255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783562540.202438:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:0:x1870200553230848:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 64us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.202445:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00080000:3.0:1783562540.202980:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783562540.204517:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.204669:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231232 00000100:00100000:0.0:1783562540.204677:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231232 00000100:00100000:0.0:1783562540.204793:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562540.204804:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:16863:x1870200553231232:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783562540.204889:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:16863:x1870200553231232:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.204898:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562540.209324:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.209374:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562540.209503:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562540.209558:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231616 00000100:00100000:3.0:1783562540.209567:0:18258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231616 00000100:00100000:3.0:1783562540.209607:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:3.0:1783562540.209643:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:16863:x1870200553231616:12345-192.168.204.4@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783562540.209847:0:18258:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783562540.210012:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+6:16863:x1870200553231616:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 373us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562540.210021:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:2.0:1783562540.212042:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231488 00000100:00100000:1.0:1783562540.212042:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231360 00000100:00100000:1.0:1783562540.212055:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231360 00000100:00100000:2.0:1783562540.212056:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231488 00000100:00100000:1.0:1783562540.212194:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:1.0:1783562540.212202:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1870200553231360:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783562540.212237:0:19334:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e31afcae-9644-4783-bdb1-165e2dd15acb@192.168.204.4@tcp t0 exp 0000000000000000 cur 349 last 0 00000100:00100000:2.0:1783562540.212453:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562540.212459:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870200553231488:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783562540.212479:0:18891:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e31afcae-9644-4783-bdb1-165e2dd15acb@192.168.204.4@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1783562540.212484:0:19334:0:(genops.c:1406:class_connect()) connect: client e31afcae-9644-4783-bdb1-165e2dd15acb, cookie 0x4738ba0933b89cb6 00002000:00100000:1.0:1783562540.212500:0:19334:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e31afcae-9644-4783-bdb1-165e2dd15acb/ffff9bfbc7fd6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1783562540.212502:0:18891:0:(genops.c:1406:class_connect()) connect: client e31afcae-9644-4783-bdb1-165e2dd15acb, cookie 0x4738ba0933b89cbd 00002000:00100000:2.0:1783562540.212512:0:18891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e31afcae-9644-4783-bdb1-165e2dd15acb/ffff9bfcef3ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783562540.212515:0:19334:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1783562540.212519:0:18891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783562540.212636:0:18891:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1783562540.212664:0:19334:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783562540.212673:0:18891:0:(import.c:65:import_set_state_nolock()) ffff9bfcef3aa000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783562540.212686:0:19334:0:(import.c:65:import_set_state_nolock()) ffff9bfbc7fd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783562540.212752:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+6:2360:x1870200553231488:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 284us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562540.212753:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcefb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+6:2360:x1870200553231360:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 549us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562540.212768:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:1.0:1783562540.212775:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:2.0:1783562540.302951:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562540.303311:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231744 00000100:00100000:1.0:1783562540.303335:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231744 00000100:00100000:1.0:1783562540.303400:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:1.0:1783562540.303429:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+6:16896:x1870200553231744:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:1.0:1783562540.303456:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562540.303481:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498a00/0x4738ba0933b89cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218c8 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303546:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303560:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303579:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562540.303770:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783562540.303775:0:20028:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783562540.303858:0:20028:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303887:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498a00/0x4738ba0933b89cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 8 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303906:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 7 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562540.303927:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:1.0:1783562540.303930:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783562540.303935:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498400, rc 0) 00000100:00100000:1.0:1783562540.304007:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+7:16896:x1870200553231744:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 580us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562540.304014:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562540.919668:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783562540.919744:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562540.919974:0:18893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675520 00000100:00100000:0.0:1783562540.919983:0:18893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675520 00000100:00100000:0.0:1783562540.920049:0:18893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783562540.920059:0:18893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563675520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783562540.920084:0:18893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562540.920141:0:18893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563675520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562540.920149:0:18893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783562540.920209:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562540.920394:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563675520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783562541.110930:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783562541.958855:0:20119:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1783562541.968517:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848 00000001:00100000:3.0:1783562541.968535:0:6574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e31afcae-9644-4783-bdb1-165e2dd15acb 00010000:00010000:1.0:1783562542.134677:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783562542.262809:0:18288:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783562542.262820:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562542.263704:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:2.0:1783562542.263785:0:18288:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783562542.263824:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1783562543.159317:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783562543.478824:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783562543.478865:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783562543.478945:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562543.479024:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675648 00000100:00100000:0.0:1783562543.479035:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675648 00000100:00100000:0.0:1783562543.479113:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783562543.479124:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563675648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783562543.479186:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562543.479266:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3272:x1870200563675648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562543.479286:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783562543.479318:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562543.479374:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562543.482299:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563675776:0@lo:400:kworker.0 00000100:00100000:3.0:1783562543.482504:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562543.482559:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675776 00000100:00100000:3.0:1783562543.482564:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563676288:0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.482569:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675776 00000100:00100000:3.0:1783562543.482607:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562543.482631:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783562543.482636:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562543.482642:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3274:x1870200563675776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562543.482647:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563675904:0@lo:400:kworker.0 00000100:00100000:3.0:1783562543.482681:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562543.482698:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3274:x1870200563675776:12345-0@lo:400:kworker.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562543.482722:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563675776:0@lo:400:kworker.0 00000100:00100000:1.0:1783562543.482727:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563676032:0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.482764:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783562543.482768:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563676160:0@lo:400:kworker.0 00000100:00100000:1.0:1783562543.482772:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562543.482812:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676288 00000100:00100000:2.0:1783562543.482816:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676288 00000100:00100000:2.0:1783562543.482844:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676032 00000100:00100000:2.0:1783562543.482845:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676032 00000100:00100000:3.0:1783562543.482994:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562543.483034:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563675904 00000100:00100000:3.0:1783562543.483038:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563675904 00000100:00100000:3.0:1783562543.483072:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783562543.483081:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563675904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.483250:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676160 00000100:00100000:2.0:1783562543.483255:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676160 00000100:00100000:2.0:1783562543.483276:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562543.483282:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563676288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.483337:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1870200563676288:12345-0@lo:400:kworker.0 Request processed in 55us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562543.483345:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783562543.483361:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562543.483377:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783562543.483382:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563676032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.483390:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563676160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783562543.483461:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1870200563676032:12345-0@lo:400:kworker.0 Request processed in 90us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562543.483468:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783562543.483474:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1870200563676160:12345-0@lo:400:kworker.0 Request processed in 87us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562543.483483:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1783562543.483498:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783562543.483505:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783562543.483542:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3273:1870200563676160:0@lo:400:kworker.0 00000100:00100000:0.0:1783562543.483578:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3272:1870200563676032:0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.483583:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3274:1870200563676288:0@lo:400:kworker.0 00000100:00100000:2.0:1783562543.483898:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563675904:12345-0@lo:400:kworker.0 Request processed in 818us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562543.483907:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783562543.483943:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563675904:0@lo:400:kworker.0 00000001:00100000:2.0:1783562543.520360:0:5776:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e31afcae-9644-4783-bdb1-165e2dd15acb 00000001:00080000:2.0:1783562543.528291:0:7460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1783562543.528353:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783562543.528393:0:7460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e31afcae-9644-4783-bdb1-165e2dd15acb 00010000:00010000:2.0:1783562544.182880:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783562544.257224:0:20269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc215f9490 20000000:00000080:0.0:1783562544.257251:0:20269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bfbc7b82800 uarg=0000000000000000 20000000:01000000:0.0:1783562544.257304:0:20269:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783562544.257310:0:20269:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783562544.257315:0:20269:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783562544.258224:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1783562544.258470:0:20269:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783562544.264604:0:20269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783562544.264648:0:20269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264676:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b8998a expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264705:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b899de expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264712:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264724:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264732:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264741:0:20269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264799:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.264818:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 12 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.264848:0:20269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676416:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562544.265089:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.265097:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 12 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.265106:0:20269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676544:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562544.265146:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.265153:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.265163:0:20269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676672:0@lo:104: 00000100:00100000:0.0:1783562544.265211:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562544.265258:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.265266:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 18 pid: 18247 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.265275:0:20269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676800:0@lo:104: 00000100:00100000:0.0:1783562544.265301:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783562544.265333:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.265341:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 18 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.265349:0:20269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676928:0@lo:104: 00000100:00100000:0.0:1783562544.265375:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562544.265388:0:20269:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5e7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783562544.267128:0:18237:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783562544.267154:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676672 00000100:00100000:2.0:1783562544.267164:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676672 00000100:00100000:2.0:1783562544.267206:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676800 00000100:00100000:2.0:1783562544.267209:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676800 00000100:00100000:2.0:1783562544.267218:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563676928 00000100:00100000:2.0:1783562544.267221:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563676928 00000100:00100000:2.0:1783562544.267235:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562544.267244:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:20269:x1870200563676672:12345-0@lo:104: 00010000:00010000:2.0:1783562544.267262:0:18237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267340:0:18237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783562544.267346:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+5:20269:x1870200563676672:12345-0@lo:104: Request processed in 104us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.267353:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562544.267370:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562544.267376:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+4:20269:x1870200563676800:12345-0@lo:104: 00010000:00010000:2.0:1783562544.267384:0:18237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267436:0:18237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783562544.267442:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+4:20269:x1870200563676800:12345-0@lo:104: Request processed in 67us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.267448:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562544.267460:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562544.267466:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:20269:x1870200563676928:12345-0@lo:104: 00010000:00010000:2.0:1783562544.267487:0:18237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267523:0:18237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783562544.267528:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:985d615a-b40a-4e93-ba73-7a6a65910c9a+3:20269:x1870200563676928:12345-0@lo:104: Request processed in 63us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.267534:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783562544.267579:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783562544.267586:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267595:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf698e800 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562544.267601:0:20030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267613:0:20030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562544.267622:0:20030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562544.267629:0:20030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783562544.267665:0:20030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267672:0:20030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562544.267694:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267702:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcf698e800/0x4738ba0933b89b2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89b35 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267722:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783562544.267726:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267732:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031a00 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562544.267736:0:20030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267742:0:20030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562544.267750:0:20030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562544.267755:0:20030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783562544.267768:0:20030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267773:0:20030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562544.267789:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267797:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc0031a00/0x4738ba0933b899de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b899e5 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267806:0:20030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783562544.267809:0:20030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267827:0:20030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc13d3200 already unused, calling callback (ffffffffc1a65c20) 10000000:00010000:2.0:1783562544.267831:0:20030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267853:0:20030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783562544.267859:0:20030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783562544.267864:0:20030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783562544.267877:0:20030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267883:0:20030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783562544.267890:0:20030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267897:0:20030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff9bfcc13d3200/0x4738ba0933b8998a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4738ba0933b89998 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.267912:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562544.267914:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783562544.267916:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562544.267925:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783562544.267942:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563677056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.267980:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562544.268030:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563677184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.268066:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562544.268085:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783562544.268090:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563677312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.268111:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562544.268147:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563677056 00000100:00100000:2.0:1783562544.268151:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563677056 00010000:00010000:2.0:1783562544.268174:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 19 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562544.268190:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563677184 00000100:00100000:2.0:1783562544.268193:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563677184 00010000:00010000:2.0:1783562544.268203:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 20 pid: 18247 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562544.268212:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563677312 00000100:00100000:2.0:1783562544.268215:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563677312 00010000:00010000:2.0:1783562544.268224:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 21 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562544.268235:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562544.268241:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+21:3274:x1870200563677056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562544.268254:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562544.268260:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 21 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268270:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 21 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268289:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562544.268316:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+21:3274:x1870200563677056:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.268330:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783562544.268344:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562544.268350:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+20:3272:x1870200563677184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562544.268357:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562544.268363:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 20 pid: 18247 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268377:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 20 pid: 18247 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268388:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562544.268437:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+20:3272:x1870200563677184:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.268444:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783562544.268456:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562544.268462:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7014450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3272:x1870200563677312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783562544.268469:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562544.268473:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 19 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268481:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 19 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.268491:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562544.268511:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7014450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3272:x1870200563677312:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562544.268517:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783562544.268587:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:985d615a-b40a-4e93-ba73-7a6a65910c9a:3274:1870200563677056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.268623:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563677312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.268631:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:985d615a-b40a-4e93-ba73-7a6a65910c9a:3272:1870200563677184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783562544.268768:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562544.269047:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783562544.269150:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc1498200/0x4738ba0933b89b35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b89b2e expref: 18 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.269168:0:20269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676672:0@lo:104: 00010000:00010000:0.0:1783562544.269180:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698f400/0x4738ba0933b899e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b899de expref: 17 pid: 18247 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.269199:0:20269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676800:0@lo:104: 00010000:00010000:0.0:1783562544.269214:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf698ec00/0x4738ba0933b89998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4738ba0933b8998a expref: 16 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.269223:0:20269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676928:0@lo:104: 00000100:00100000:0.0:1783562544.274066:0:20269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676416:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562544.274085:0:20269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1870200563676544:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562544.274127:0:20269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.275028:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562544.275258:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562544.275342:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553231872 00000100:00100000:0.0:1783562544.275352:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553231872 00010000:00010000:0.0:1783562544.275419:0:18239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 13 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562544.275462:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232000 00000100:00100000:2.0:1783562544.275469:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232000 00000100:00100000:0.0:1783562544.275476:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00010000:00010000:2.0:1783562544.275496:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562544.275503:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0790a268-b732-4464-ac35-a4cbdd6283cf+14:2363:x1870200553231872:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783562544.275525:0:18240:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1783562544.275526:0:18239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562544.275537:0:18239:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562544.275538:0:18241:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783562544.275538:0:18240:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783562544.275555:0:18241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:0.0:1783562544.275559:0:18239:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562544.275570:0:18241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0790a268-b732-4464-ac35-a4cbdd6283cf+14:2363:x1870200553232000:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562544.275581:0:18241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562544.275588:0:18241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562544.275602:0:18239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcf6683400/0x4738ba0933b89ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2189e expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275604:0:18241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275617:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc0030c00/0x4738ba0933b89b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2183c expref: 14 pid: 18248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275645:0:18241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275655:0:18241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275677:0:18241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275685:0:18241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275693:0:18241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275700:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275724:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517c800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562544.275730:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275741:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275769:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562544.275780:0:18241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562544.275822:0:20269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.275844:0:20269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562544.275852:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bfcc517c800/0x4738ba0933b89cd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562544.275861:0:18241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:2363:x1870200553232000:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 295us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562544.275870:0:18241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00010000:00010000:0.0:1783562544.275973:0:18239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783562544.276000:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0790a268-b732-4464-ac35-a4cbdd6283cf+11:2363:x1870200553231872:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 513us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562544.276009:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562545.199966:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.200958:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232128 00000100:00100000:2.0:1783562545.200971:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232128 00000100:00100000:2.0:1783562545.201046:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562545.201059:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:17359:x1870200553232128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562545.201089:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1783562545.201106:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783562545.201122:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218cf expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201201:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201234:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201255:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201269:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201274:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201278:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201795:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682400/0x4738ba0933b89cee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201804:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682400/0x4738ba0933b89cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.201811:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682400/0x4738ba0933b89cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562545.201916:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783562545.201920:0:18255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562545.202024:0:18255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682400/0x4738ba0933b89cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202040:0:18255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202057:0:18255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202065:0:18255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202072:0:18255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.202078:0:18255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202086:0:18255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202100:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:2.0:1783562545.202103:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.202108:0:18255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202114:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202129:0:18255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202136:0:18255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202143:0:18255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202149:0:18255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.202157:0:18255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202165:0:18255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202173:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bfcdf136200) 00010000:00010000:2.0:1783562545.202176:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.202180:0:18255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202186:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202226:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218cf expref: 8 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202240:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682400/0x4738ba0933b89cee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218cf expref: 7 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.202248:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcdf136600) 00010000:00010000:2.0:1783562545.202251:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562545.202253:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682400, rc 0) 00000100:00100000:2.0:1783562545.202342:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:17359:x1870200553232128:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1285us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.202351:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00010000:00010000:2.0:1783562545.206616:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783562545.209868:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.209994:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232384 00000100:00100000:2.0:1783562545.210006:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232384 00000100:00100000:2.0:1783562545.210122:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562545.210150:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:17359:x1870200553232384:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562545.210174:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.210201:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89cf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218d6 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210294:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210309:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210321:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210337:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210344:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.210351:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211022:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89d0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211033:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211042:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562545.211063:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783562545.211340:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211349:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211356:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211362:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.211367:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211375:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211389:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bfcdf136600) 00010000:00010000:2.0:1783562545.211393:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.211398:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211436:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89cfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211453:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211459:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211475:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211480:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.211482:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211488:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211497:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bfcdf136900) 00010000:00010000:2.0:1783562545.211499:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.211502:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211508:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211940:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89cf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218d6 expref: 10 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211958:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683600/0x4738ba0933b89d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218d6 expref: 9 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.211965:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcdf136400) 00010000:00010000:2.0:1783562545.211967:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.211970:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683600, rc 0) 00000100:00100000:2.0:1783562545.212074:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17359:x1870200553232384:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 1925us (2285us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783562545.212093:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:3.0:1783562545.216305:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.216979:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232512 00000100:00100000:2.0:1783562545.216989:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232512 00000100:00100000:2.0:1783562545.217106:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1783562545.217118:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17359:x1870200553232512:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783562545.217240:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17359:x1870200553232512:12345-192.168.204.4@tcp:59:lhsmtool_posix.0 Request processed in 123us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.217248:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562545.242479:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.242593:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232640 00000100:00100000:0.0:1783562545.242607:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232640 00000100:00100000:0.0:1783562545.242686:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:0.0:1783562545.242697:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17365:x1870200553232640:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562545.242722:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.242763:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218dd expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242850:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242869:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242885:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242957:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242966:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.242990:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243271:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243280:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243288:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243295:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562545.243300:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243310:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243326:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562545.243330:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.243335:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243342:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243358:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243365:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243377:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243383:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517cc00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562545.243386:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243393:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243462:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bfcd0d05c00) 00010000:00010000:0.0:1783562545.243466:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.243469:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243476:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243528:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218dd expref: 10 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243538:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562545.243542:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.243545:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218dd expref: 10 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.243556:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517ce00, rc 0) 00000100:00100000:0.0:1783562545.243648:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17365:x1870200553232640:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 951us (1182us total) trans 0 rc 301/301 00000100:00100000:0.0:1783562545.243665:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1783562545.249097:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562545.249226:0:18263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553232768 00000100:00100000:1.0:1783562545.249239:0:18263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553232768 00000100:00100000:1.0:1783562545.249343:0:18263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562545.249355:0:18263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17365:x1870200553232768:12345-192.168.204.4@tcp:700:lfs.0 00000100:00100000:1.0:1783562545.250121:0:18263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17365:x1870200553232768:12345-192.168.204.4@tcp:700:lfs.0 Request processed in 765us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.250132:0:18263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562545.255459:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.255590:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233024 00000100:00100000:0.0:1783562545.255601:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233024 00000100:00100000:0.0:1783562545.255670:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:0.0:1783562545.255680:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17365:x1870200553233024:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:0.0:1783562545.255744:0:18255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562545.255775:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89c93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21866 expref: 9 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.255811:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562545.255823:0:18255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562545.256104:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.256119:0:18255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 5 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.256128:0:18255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.256160:0:18255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 5 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.256174:0:18255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 5 pid: 20028 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.256190:0:18255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18255:1870200563677440:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562545.256295:0:18255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc5e7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783562545.261320:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.261736:0:18241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233152 00000100:00100000:3.0:1783562545.261747:0:18241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233152 00010000:00010000:3.0:1783562545.261844:0:18241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 6 pid: 20028 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783562545.261875:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562545.261895:0:18241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:3.0:1783562545.261908:0:18241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+6:2364:x1870200553233152:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562545.261924:0:18241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562545.261932:0:18241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 6 pid: 20028 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.261961:0:18241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 6 pid: 20028 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.261984:0:18241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:3.0:1783562545.261989:0:18241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.261999:0:18241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.262007:0:18241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.262026:0:18241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562545.262090:0:18241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+6:2364:x1870200553233152:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 184us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.262099:0:18241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00010000:00010000:0.0:1783562545.262542:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498400/0x4738ba0933b89ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218c8 expref: 5 pid: 20028 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.262563:0:18255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18255:1870200563677440:192.168.204.4@tcp:104: 00010000:00010000:0.0:1783562545.262587:0:18255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.262597:0:18255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.262603:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.263966:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.263986:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.263998:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.266528:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783562545.266705:0:18255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266718:0:18255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266727:0:18255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266742:0:18255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517d200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562545.266747:0:18255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266756:0:18255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266858:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd19d2a00) 00010000:00010000:0.0:1783562545.266862:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.266868:0:18255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.266876:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562545.266905:0:18255:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b1bcee3 reply state 00000000ebac5af2 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.266917:0:18255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562545.267091:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+10:17365:x1870200553233024:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 11405us (11638us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783562545.267101:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00010000:00010000:1.0:1783562545.270091:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270116:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270125:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270131:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562545.270150:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270159:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270187:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bfcd0d05c00) 00010000:00010000:1.0:1783562545.270191:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562545.270196:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.270203:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89d34 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.325049:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.325173:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233280 00000100:00100000:0.0:1783562545.325184:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233280 00000100:00100000:0.0:1783562545.325245:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:0.0:1783562545.325254:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:17373:x1870200553233280:12345-192.168.204.4@tcp:101:lctl.0 00010000:00010000:0.0:1783562545.325282:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.325533:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218e4 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325621:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325635:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325647:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.325706:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783562545.325710:0:20028:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562545.325751:0:20028:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325876:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218e4 expref: 11 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325897:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517cc00/0x4738ba0933b89d42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218e4 expref: 10 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.325905:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:0.0:1783562545.325908:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783562545.325911:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517cc00, rc 0) 00000100:00100000:0.0:1783562545.326017:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+10:17373:x1870200553233280:12345-192.168.204.4@tcp:101:lctl.0 Request processed in 763us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.326025:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000040:00080000:3.0:1783562545.336294:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783562545.350041:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.350214:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233408 00000100:00100000:3.0:1783562545.350226:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233408 00000100:00100000:3.0:1783562545.350495:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:3.0:1783562545.350515:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+5:17374:x1870200553233408:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562545.350548:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562545.350579:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89d49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218eb expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350680:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030e00/0x4738ba0933b89d50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350719:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030e00/0x4738ba0933b89d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350735:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030e00/0x4738ba0933b89d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562545.350846:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783562545.350851:0:18256:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562545.350890:0:18256:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030e00/0x4738ba0933b89d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350926:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89d49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218eb expref: 7 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350955:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030e00/0x4738ba0933b89d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218eb expref: 6 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.350965:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:3.0:1783562545.350968:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783562545.350972:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030e00, rc 0) 00000100:00100000:3.0:1783562545.351051:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+6:17374:x1870200553233408:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 543us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.351062:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:1.0:1783562545.354515:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.354590:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233536 00000100:00100000:2.0:1783562545.354600:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233536 00000100:00100000:2.0:1783562545.354686:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1783562545.354698:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+6:17374:x1870200553233536:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562545.354720:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.354741:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218f2 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354806:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354829:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354843:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354877:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354885:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354892:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354992:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.354998:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355003:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562545.355035:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783562545.355038:0:18254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562545.355056:0:18254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355065:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355069:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355075:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355086:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682a00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.355089:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355094:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355103:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:2.0:1783562545.355105:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.355108:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355112:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682a00/0x4738ba0933b89d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355121:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355124:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355128:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355131:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.355132:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355136:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355146:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bfcdf136900) 00010000:00010000:2.0:1783562545.355158:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.355160:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355164:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89d65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355189:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218f2 expref: 8 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355201:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218f2 expref: 7 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.355208:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136200) 00010000:00010000:2.0:1783562545.355210:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562545.355212:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682c00, rc 0) 00000100:00100000:2.0:1783562545.355294:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+7:17374:x1870200553233536:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 600us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.355301:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1783562545.361582:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.362921:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553233792 00000100:00100000:0.0:1783562545.362939:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553233792 00000100:00100000:0.0:1783562545.363048:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:0.0:1783562545.363059:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+7:17374:x1870200553233792:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562545.363084:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.363108:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c218f9 expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.363250:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783562545.363385:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218f9 expref: 9 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.363399:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:0.0:1783562545.363430:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562545.363437:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218f9 expref: 9 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.363451:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517d200, rc 0) 00000100:00100000:0.0:1783562545.363515:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+8:17374:x1870200553233792:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 458us (1948us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1783562545.363524:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1783562545.366189:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.366283:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553234048 00000100:00100000:0.0:1783562545.366296:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553234048 00000100:00100000:0.0:1783562545.366453:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:0.0:1783562545.366465:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+8:17374:x1870200553234048:12345-192.168.204.4@tcp:36:lfs.0 00010000:00010000:0.0:1783562545.366531:0:20028:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562545.366561:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89d6c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c218f2 expref: 8 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.366612:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136200) 00010000:00010000:0.0:1783562545.366623:0:20028:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562545.366653:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.366666:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.366676:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562545.366953:0:20028:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008227928a reply state 00000000a44ff8f4 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.366965:0:20028:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783562545.366981:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1783562545.367076:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+9:17374:x1870200553234048:12345-192.168.204.4@tcp:36:lfs.0 Request processed in 614us (899us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1783562545.367082:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00010000:00010000:2.0:1783562545.369522:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369546:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369555:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369593:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.369598:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369606:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369630:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcd0d05800) 00010000:00010000:2.0:1783562545.369632:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783562545.369638:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.369643:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89d81 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.369799:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.370056:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553234304 00000100:00100000:2.0:1783562545.370069:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553234304 00000100:00100000:2.0:1783562545.370123:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:2.0:1783562545.370131:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+8:17374:x1870200553234304:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562545.370467:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+9:17374:x1870200553234304:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 336us (672us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1783562545.370472:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:1.0:1783562545.373288:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.373510:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553234560 00000100:00100000:3.0:1783562545.373521:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553234560 00000100:00100000:3.0:1783562545.373586:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:3.0:1783562545.373599:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+9:17374:x1870200553234560:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:3.0:1783562545.373629:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562545.373668:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21900 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373753:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373767:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373778:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373796:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373803:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.373810:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562545.374162:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783562545.374524:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374534:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374541:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374549:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0030c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562545.374561:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374583:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374597:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:3.0:1783562545.374600:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562545.374604:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374608:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374620:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374624:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374629:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374638:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:3.0:1783562545.374640:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374644:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374648:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bfcd19d2800) 00010000:00010000:3.0:1783562545.374652:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783562545.374654:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374665:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374711:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89d88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21900 expref: 11 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374718:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:3.0:1783562545.374720:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783562545.374722:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21900 expref: 11 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.374728:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030a00, rc 0) 00000100:00100000:3.0:1783562545.374808:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e31afcae-9644-4783-bdb1-165e2dd15acb+10:17374:x1870200553234560:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1213us (1531us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1783562545.374825:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:1.0:1783562545.379382:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.379528:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553234688 00000100:00100000:2.0:1783562545.379539:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553234688 00000100:00100000:2.0:1783562545.379597:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:2.0:1783562545.379608:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+10:17374:x1870200553234688:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:2.0:1783562545.379636:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.380173:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89da4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21907 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380282:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380295:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380306:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562545.380354:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783562545.380357:0:18254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783562545.380377:0:18254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380513:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683800/0x4738ba0933b89da4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 12 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380533:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 11 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.380542:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136900) 00010000:00010000:2.0:1783562545.380544:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783562545.380548:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682e00, rc 0) 00000100:00100000:2.0:1783562545.380668:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+11:17374:x1870200553234688:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1061us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.380675:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:1.0:1783562545.383801:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.383869:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553234816 00000100:00100000:2.0:1783562545.383897:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553234816 00000100:00100000:3.0:1783562545.383993:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:3.0:1783562545.384006:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+11:17374:x1870200553234816:12345-192.168.204.4@tcp:37:lfs.0 00000100:00100000:2.0:1783562545.387239:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+11:17374:x1870200553234816:12345-192.168.204.4@tcp:37:lfs.0 Request processed in 3223us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.387255:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:1.0:1783562545.391758:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.393509:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235072 00000100:00100000:0.0:1783562545.393525:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235072 00000100:00100000:0.0:1783562545.393597:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:0.0:1783562545.393608:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+11:17374:x1870200553235072:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562545.393905:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+12:17374:x1870200553235072:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 297us (2163us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783562545.393913:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562545.406219:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.406316:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235200 00000100:00100000:2.0:1783562545.406332:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235200 00000100:00100000:2.0:1783562545.406461:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:2.0:1783562545.406474:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+11:16749:x1870200553235200:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562545.406493:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.406516:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b89db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2190e expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.406549:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b89db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2190e expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.406563:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6683800/0x4738ba0933b89db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2190e expref: 12 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.406573:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683800, rc 0) 00000100:00100000:2.0:1783562545.406658:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235200:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 186us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.406665:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:1.0:1783562545.418223:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.418314:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235328 00000100:00100000:2.0:1783562545.418327:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235328 00000100:00100000:2.0:1783562545.418483:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:2.0:1783562545.418495:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235328:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562545.418876:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235328:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 383us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.418896:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:1.0:1783562545.424449:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.424516:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235456 00000100:00100000:0.0:1783562545.424542:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235456 00000100:00100000:0.0:1783562545.424622:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:0.0:1783562545.424633:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235456:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.425026:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235456:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 394us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.425036:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:1.0:1783562545.433830:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.433969:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235584 00000100:00100000:0.0:1783562545.434036:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235584 00000100:00100000:0.0:1783562545.434141:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:0.0:1783562545.434162:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+10:17380:x1870200553235584:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562545.434188:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.434210:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21915 expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434286:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434302:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434317:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434333:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434340:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434347:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434547:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c200/0x4738ba0933b89dce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434557:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c200/0x4738ba0933b89dce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434564:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c200/0x4738ba0933b89dce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.434606:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783562545.434611:0:18255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562545.434763:0:18255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c200/0x4738ba0933b89dce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434777:0:18255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434785:0:18255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434792:0:18255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434798:0:18255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562545.434802:0:18255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434821:0:18255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434835:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:0.0:1783562545.434844:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.434850:0:18255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434856:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434874:0:18255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434880:0:18255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434886:0:18255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434891:0:18255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517ce00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562545.434894:0:18255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434900:0:18255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434907:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562545.434910:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562545.434912:0:18255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434917:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517ce00/0x4738ba0933b89dc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434957:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d200/0x4738ba0933b89db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21915 expref: 12 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.434995:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c200/0x4738ba0933b89dce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21915 expref: 11 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.435002:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136900) 00010000:00010000:0.0:1783562545.435004:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783562545.435007:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517c200, rc 0) 00000100:00100000:0.0:1783562545.435085:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+11:17380:x1870200553235584:12345-192.168.204.4@tcp:101:bash.0 Request processed in 933us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.435093:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:1.0:1783562545.435903:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.436029:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235712 00000100:00100000:2.0:1783562545.436040:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235712 00000100:00100000:2.0:1783562545.436122:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:2.0:1783562545.436131:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+12:16749:x1870200553235712:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562545.436147:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.436162:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682a00/0x4738ba0933b89dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2191c expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.436185:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682a00/0x4738ba0933b89dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2191c expref: 13 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.436196:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682a00/0x4738ba0933b89dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2191c expref: 13 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.436203:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682a00, rc 0) 00000100:00100000:2.0:1783562545.436245:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16749:x1870200553235712:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.436251:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:1.0:1783562545.437877:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.437973:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553235968 00000100:00100000:0.0:1783562545.438032:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553235968 00000100:00100000:0.0:1783562545.438096:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:0.0:1783562545.438106:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+11:17380:x1870200553235968:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:0.0:1783562545.438125:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.438149:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c800/0x4738ba0933b89ddc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21923 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.438309:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.438325:0:20028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 11 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.438334:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.438379:0:20028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 11 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.438557:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.438615:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236096 00000100:00100000:2.0:1783562545.438621:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236096 00000100:00100000:2.0:1783562545.438649:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:2.0:1783562545.438656:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16749:x1870200553236096:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562545.439050:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16749:x1870200553236096:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 392us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.439059:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00010000:00010000:0.0:1783562545.439157:0:20028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 11 pid: 18254 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.439177:0:20028:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20028:1870200563677568:192.168.204.4@tcp:104: 00000100:00100000:0.0:1783562545.439245:0:20028:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcd81d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783562545.446664:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.446849:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.447389:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236224 00000100:00100000:2.0:1783562545.447488:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236224 00000100:00100000:3.0:1783562545.447542:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236352 00000100:00100000:3.0:1783562545.447548:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236352 00010000:00010000:3.0:1783562545.447589:0:18239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 12 pid: 18254 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562545.447640:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:2.0:1783562545.447645:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:3.0:1783562545.447654:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+12:2364:x1870200553236352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783562545.447661:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16749:x1870200553236224:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00010000:00010000:3.0:1783562545.447677:0:18239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562545.447828:0:18239:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 12 pid: 18254 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.447845:0:18239:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 12 pid: 18254 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.447878:0:18239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136900) 00010000:00010000:3.0:1783562545.447884:0:18239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.447897:0:18239:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.447907:0:18239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.447933:0:18239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562545.447974:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0790a268-b732-4464-ac35-a4cbdd6283cf+13:16749:x1870200553236224:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 318us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.447984:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00010000:00010000:1.0:1783562545.448061:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89dab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21907 expref: 12 pid: 18254 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.448084:0:20028:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20028:1870200563677568:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562545.448110:0:20028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.448120:0:20028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.448126:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.448199:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.448211:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.448221:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451022:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451048:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451064:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783562545.451082:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:3.0:1783562545.451128:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e31afcae-9644-4783-bdb1-165e2dd15acb+11:2364:x1870200553236352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 3469us (4269us total) trans 0 rc 0/0 00010000:00010000:1.0:1783562545.451136:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562545.451144:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00010000:00010000:1.0:1783562545.451149:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451159:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451167:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517d800 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562545.451173:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451182:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451198:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136900) 00010000:00010000:1.0:1783562545.451203:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562545.451208:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451216:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d800/0x4738ba0933b89de3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783562545.451236:0:20028:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a0ee99a reply state 00000000a44ce623 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.451247:0:20028:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783562545.451300:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c800/0x4738ba0933b89ddc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 14 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.451321:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 13 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.452654:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:1.0:1783562545.452663:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783562545.452668:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499000, rc 0) 00000100:00100000:1.0:1783562545.452921:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17380:x1870200553235968:12345-192.168.204.4@tcp:101:bash.0 Request processed in 14813us (15050us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783562545.452930:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00010000:00010000:1.0:1783562545.457478:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457581:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457593:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457600:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:1.0:1783562545.457608:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457617:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457638:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bfcc3bd0a00) 00010000:00010000:1.0:1783562545.457642:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783562545.457648:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.457656:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1498200/0x4738ba0933b89dea lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.467960:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.468145:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236480 00000100:00100000:3.0:1783562545.468158:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236480 00000100:00100000:3.0:1783562545.468751:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:3.0:1783562545.468788:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+13:17380:x1870200553236480:12345-192.168.204.4@tcp:101:bash.0 00010000:00010000:3.0:1783562545.468844:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562545.468880:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89dff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2192a expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.468957:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.468989:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.469004:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562545.469069:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783562545.469074:0:18256:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783562545.469098:0:18256:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.469109:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.469139:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89dff lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 15 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.469161:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 14 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.469171:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:3.0:1783562545.469174:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562545.469178:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0031800, rc 0) 00000100:00100000:3.0:1783562545.469268:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17380:x1870200553236480:12345-192.168.204.4@tcp:101:bash.0 Request processed in 505us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.469276:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:2.0:1783562545.472244:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.472335:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236736 00000100:00100000:3.0:1783562545.472347:0:18258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236736 00000100:00100000:3.0:1783562545.472462:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:3.0:1783562545.472496:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17380:x1870200553236736:12345-192.168.204.4@tcp:35:bash.0 00000100:00100000:2.0:1783562545.473143:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:17380:x1870200553236736:12345-192.168.204.4@tcp:35:bash.0 Request processed in 650us (910us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1783562545.473154:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:2.0:1783562545.536878:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.539025:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553236992 00000100:00100000:0.0:1783562545.539045:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553236992 00000100:00100000:0.0:1783562545.539138:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1783562545.539150:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:17392:x1870200553236992:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562545.539182:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.539205:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21931 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.539359:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783562545.539527:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89e0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21931 expref: 17 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.539542:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bfcd0d05000) 00010000:00010000:0.0:1783562545.539545:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783562545.539551:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21931 expref: 17 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.539569:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517da00, rc 0) 00000100:00100000:0.0:1783562545.539674:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:17392:x1870200553236992:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 525us (2805us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1783562545.539682:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1783562545.542297:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.542374:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553237248 00000100:00100000:2.0:1783562545.542384:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553237248 00000100:00100000:2.0:1783562545.542520:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562545.542529:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:17392:x1870200553237248:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:2.0:1783562545.542883:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+17:17392:x1870200553237248:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 353us (594us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1783562545.542891:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:2.0:1783562545.585333:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.585630:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553237504 00000100:00100000:0.0:1783562545.585648:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553237504 00000100:00100000:0.0:1783562545.585732:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:0.0:1783562545.585744:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+17:17395:x1870200553237504:12345-192.168.204.4@tcp:101:lfs.0 00010000:00010000:0.0:1783562545.585789:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562545.585827:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89e1b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21938 expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.585980:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517de00/0x4738ba0933b89e22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.585999:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517de00/0x4738ba0933b89e22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.586016:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517de00/0x4738ba0933b89e22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562545.586030:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783562545.586318:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89e1b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21938 expref: 20 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.586344:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517de00/0x4738ba0933b89e22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21938 expref: 19 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.586354:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:0.0:1783562545.586377:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783562545.586382:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517de00, rc 0) 00000100:00100000:0.0:1783562545.587311:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:17395:x1870200553237504:12345-192.168.204.4@tcp:101:lfs.0 Request processed in 1562us (1987us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1783562545.587324:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:0.0:1783562545.590651:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.590734:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553237632 00000100:00100000:2.0:1783562545.590758:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553237632 00000100:00100000:2.0:1783562545.590846:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:2.0:1783562545.590859:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:17395:x1870200553237632:12345-192.168.204.4@tcp:54:lfs.0 00010000:00010000:2.0:1783562545.590948:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.590993:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591011:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591047:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591055:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591063:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591070:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.591075:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591084:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591097:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.591101:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562545.591105:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591111:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e30 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562545.591217:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:17395:x1870200553237632:12345-192.168.204.4@tcp:54:lfs.0 Request processed in 360us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.591234:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:3.0:1783562545.591282:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.591717:0:18241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553237760 00000100:00100000:2.0:1783562545.591724:0:18241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553237760 00000100:00100000:2.0:1783562545.591781:0:18241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:2.0:1783562545.591789:0:18241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:2363:x1870200553237760:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562545.591802:0:18241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562545.591831:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517de00/0x4738ba0933b89e22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21938 expref: 19 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.591846:0:18241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.591850:0:18241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562545.591883:0:18241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:2363:x1870200553237760:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 95us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.591890:0:18241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562545.594538:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.594631:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238016 00000100:00100000:0.0:1783562545.594645:0:18258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238016 00000100:00100000:0.0:1783562545.594756:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562545.594768:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:17395:x1870200553238016:12345-192.168.204.4@tcp:35:lfs.0 00000100:00100000:0.0:1783562545.595120:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:17395:x1870200553238016:12345-192.168.204.4@tcp:35:lfs.0 Request processed in 353us (596us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1783562545.595129:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:3.0:1783562545.597283:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.597323:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.597600:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562545.597615:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238144 00000100:00100000:1.0:1783562545.597628:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238144 00000100:00100000:1.0:1783562545.597738:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238400 00000100:00100000:1.0:1783562545.597742:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238400 00000100:00100000:2.0:1783562545.597782:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:2.0:1783562545.597797:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2364:x1870200553238144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1783562545.597888:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2364:x1870200553238144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 95us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.597897:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00080000:0.0:1783562545.597977:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783562545.598091:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:1.0:1783562545.598099:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+5:2364:x1870200553238400:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1783562545.598130:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e31afcae-9644-4783-bdb1-165e2dd15acb+5:2364:x1870200553238400:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.598137:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562545.598949:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.599741:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238272 00000100:00100000:2.0:1783562545.599753:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238272 00000100:00080000:1.0:1783562545.599872:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783562545.600033:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238528 00000100:00100000:0.0:1783562545.600038:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238528 00000100:00100000:0.0:1783562545.600132:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562545.600145:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2364:x1870200553238272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562545.600232:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2364:x1870200553238272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.600240:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:0.0:1783562545.600260:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:0.0:1783562545.600266:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+5:2364:x1870200553238528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1783562545.600291:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e31afcae-9644-4783-bdb1-165e2dd15acb+5:2364:x1870200553238528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.600297:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00080000:1.0:1783562545.601075:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783562545.798556:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562545.799124:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238784 00000100:00100000:3.0:1783562545.799136:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238784 00000100:00100000:3.0:1783562545.799224:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:3.0:1783562545.799237:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:17426:x1870200553238784:12345-192.168.204.4@tcp:101:cat.0 00010000:00010000:3.0:1783562545.799273:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783562545.799304:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89e37 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2193f expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.799471:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89e3e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.799491:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89e3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.799506:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89e3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783562545.799519:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783562545.799696:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030c00/0x4738ba0933b89e37 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2193f expref: 22 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.799724:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89e3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2193f expref: 21 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.799751:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:3.0:1783562545.799754:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783562545.799758:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc0030a00, rc 0) 00000100:00100000:3.0:1783562545.799845:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:17426:x1870200553238784:12345-192.168.204.4@tcp:101:cat.0 Request processed in 612us (1308us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1783562545.799852:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 32 00000100:00100000:0.0:1783562545.809271:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.809839:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.810956:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553239168 00000100:00100000:2.0:1783562545.810980:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553239168 00000100:00100000:2.0:1783562545.811254:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:2.0:1783562545.811270:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:17426:x1870200553239168:12345-192.168.204.4@tcp:35:cat.0 00000100:00100000:2.0:1783562545.811854:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+22:17426:x1870200553239168:12345-192.168.204.4@tcp:35:cat.0 Request processed in 587us (2013us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1783562545.811863:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:1.0:1783562545.812959:0:20271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553238912 00000100:00100000:1.0:1783562545.812973:0:20271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553238912 00000100:00100000:1.0:1783562545.813679:0:20271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:1.0:1783562545.813695:0:20271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+22:2363:x1870200553238912:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562545.813717:0:20271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562545.813762:0:20271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0030a00/0x4738ba0933b89e3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2193f expref: 22 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.813789:0:20271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:1.0:1783562545.813794:0:20271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562545.813878:0:20271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:2363:x1870200553238912:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 187us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.813888:0:20271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:0.0:1783562545.849575:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.851207:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553239424 00000100:00100000:2.0:1783562545.851238:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553239424 00000100:00100000:2.0:1783562545.851358:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:2.0:1783562545.851372:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:17432:x1870200553239424:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1783562545.851433:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.851460:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e4c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21946 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851578:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851592:0:18254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 22 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851600:0:18254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 22 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851608:0:18254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851657:0:18254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 22 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851670:0:18254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 22 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562545.851706:0:18254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18254:1870200563677696:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562545.851861:0:18254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 22 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.851871:0:18254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 22 pid: 20028 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562545.851881:0:18254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18254:1870200563677824:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562545.851906:0:18254:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc66ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1783562545.855538:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562545.855587:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562545.855708:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553239552 00000100:00100000:1.0:1783562545.855717:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553239552 00000100:00100000:2.0:1783562545.855723:0:18254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18254:1870200563677696:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562545.855743:0:18254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18254:1870200563677824:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562545.855784:0:18254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.855791:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 23 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562545.855820:0:18241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553239680 00000100:00100000:3.0:1783562545.855827:0:18241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553239680 00010000:00010000:3.0:1783562545.855850:0:18241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 24 pid: 20028 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.855855:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:1.0:1783562545.855872:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7014050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:2363:x1870200553239552:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783562545.855888:0:18241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:3.0:1783562545.855898:0:18241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:2363:x1870200553239680:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783562545.855899:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562545.855909:0:18241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783562545.855913:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 24 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.855918:0:18241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 24 pid: 20028 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.855940:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 24 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.856292:0:18241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 24 pid: 20028 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562545.856316:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499000/0x4738ba0933b89df1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21923 expref: 24 pid: 20028 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.856354:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc0031800/0x4738ba0933b89e06 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2192a expref: 24 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.856377:0:18240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:1.0:1783562545.856382:0:18240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.856391:0:18240:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.856398:0:18240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.856459:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562545.856492:0:18254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.856499:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562545.856518:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783562545.856527:0:18241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:3.0:1783562545.856532:0:18241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783562545.856615:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7014050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:2363:x1870200553239552:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 745us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.856624:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:3.0:1783562545.856662:0:18241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+22:2363:x1870200553239680:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 765us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.856672:0:18241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00010000:00010000:2.0:1783562545.856753:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e4c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21946 expref: 22 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.856769:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682800/0x4738ba0933b89e53 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21946 expref: 21 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.856779:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.856781:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783562545.856783:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682800, rc 0) 00000100:00100000:2.0:1783562545.856855:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:17432:x1870200553239424:12345-192.168.204.4@tcp:101:dd.0 Request processed in 5487us (7297us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1783562545.856860:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 33 00000100:00100000:3.0:1783562545.859315:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.859458:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553239936 00000100:00100000:2.0:1783562545.859471:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553239936 00000100:00100000:2.0:1783562545.859542:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 34 00000100:00100000:2.0:1783562545.859554:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:17432:x1870200553239936:12345-192.168.204.4@tcp:36:dd.0 00010000:00010000:2.0:1783562545.859927:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.859946:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.859958:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562545.860060:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1783562545.860090:0:18256:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f56e28b4 reply state 0000000006cc7f4c transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562545.860102:0:18256:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783562545.860198:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17432:x1870200553239936:12345-192.168.204.4@tcp:36:dd.0 Request processed in 645us (892us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1783562545.860207:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 34 00000020:00080000:2.0:1783562545.860220:0:18256:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783562545.862034:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862049:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862055:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862059:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562545.862062:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862067:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862080:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.862083:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562545.862085:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.862089:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e61 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562545.862868:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562545.863006:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240064 00000100:00100000:1.0:1783562545.863019:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240064 00000100:00100000:1.0:1783562545.863160:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:1.0:1783562545.863171:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:17432:x1870200553240064:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1783562545.863194:0:20028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562545.863211:0:20028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499c00/0x4738ba0933b89e68 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2194d expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.863460:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499c00/0x4738ba0933b89e68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2194d expref: 24 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.863476:0:20028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499c00/0x4738ba0933b89e68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2194d expref: 24 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.863496:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:1.0:1783562545.863499:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783562545.863502:0:20028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1499c00, rc 0) 00000100:00100000:1.0:1783562545.863602:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17432:x1870200553240064:12345-192.168.204.4@tcp:101:dd.0 Request processed in 433us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.863608:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 35 00000100:00100000:0.0:1783562545.874453:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.874872:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240320 00000100:00100000:2.0:1783562545.874886:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240320 00000100:00100000:2.0:1783562545.875056:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:2.0:1783562545.875069:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17432:x1870200553240320:12345-192.168.204.4@tcp:103:dd.0 00010000:00010000:2.0:1783562545.875093:0:18239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562545.875139:0:18239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc1499c00/0x4738ba0933b89e68 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2194d expref: 24 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.875182:0:18239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.875188:0:18239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783562545.875255:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:17432:x1870200553240320:12345-192.168.204.4@tcp:103:dd.0 Request processed in 190us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.875263:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:0.0:1783562545.877848:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.877992:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240448 00000100:00100000:2.0:1783562545.878005:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240448 00000100:00100000:2.0:1783562545.878076:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:2.0:1783562545.878087:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:17432:x1870200553240448:12345-192.168.204.4@tcp:58:dd.0 00010000:00010000:2.0:1783562545.879448:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.879474:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.879500:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783562545.881080:0:18255:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783562545.881317:0:18255:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1783562545.881398:0:18255:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1783562545.882351:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:17432:x1870200553240448:12345-192.168.204.4@tcp:58:dd.0 Request processed in 4254us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.882366:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 36 00000100:00100000:3.0:1783562545.884282:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562545.884507:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240576 00000100:00100000:2.0:1783562545.884520:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240576 00000100:00100000:2.0:1783562545.884589:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 37 00000100:00100000:2.0:1783562545.884600:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+23:17432:x1870200553240576:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1783562545.884642:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.884667:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21954 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884736:0:18254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884747:0:18254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 24 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884766:0:18254:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884780:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 24 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884794:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562545.884798:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562545.884820:0:18254:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 24 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.884830:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683c00, rc 0) 00000100:00100000:2.0:1783562545.884890:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17432:x1870200553240576:12345-192.168.204.4@tcp:101:dd.0 Request processed in 291us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.884897:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 37 10000000:01000000:1.0:1783562545.910686:0:18251:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783562545.910697:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcf6165800 from 10 10000000:01000000:1.0:1783562545.910705:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783562545.910779:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.910793:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.910844:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.910879:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563677952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.910992:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562545.911086:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562545.911149:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563677952 00000100:00100000:2.0:1783562545.911161:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563677952 00000100:00100000:2.0:1783562545.911232:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783562545.912363:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+16:18251:x1870200563677952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562545.912388:0:18249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.912432:0:18249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b89e84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89e7d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.912472:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b89e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89e7d expref: 17 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.912487:0:18249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682000/0x4738ba0933b89e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89e7d expref: 17 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.912498:0:18249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682000, rc 0) 00000100:00100000:2.0:1783562545.912588:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563677952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1338us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.912598:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783562545.912834:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563677952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562545.912856:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e84 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.912867:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89e84 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.912959:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.912997:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562545.913168:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562545.913262:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678080 00000100:00100000:2.0:1783562545.913270:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678080 00000100:00100000:2.0:1783562545.913358:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783562545.913368:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563678080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562545.913747:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563678080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 379us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.913755:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783562545.913831:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.913869:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.913913:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562545.914113:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218900 going to sleep for 11 seconds 00000100:00100000:0.0:1783562545.914208:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678208 00000100:00100000:0.0:1783562545.914215:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678208 00000100:00100000:0.0:1783562545.914245:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783562545.914254:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcd1934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563678208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.914471:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcd1934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563678208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.914480:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783562545.914585:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562545.915568:0:20283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783562545.915779:0:18251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783562545.915800:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562545.915823:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e84 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.915834:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc1498a00/0x4738ba0933b89e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e84 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562545.915845:0:18251:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783562545.915848:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfcc3f25000 from 10 10000000:01000000:0.0:1783562545.915851:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562545.915893:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.915902:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.915930:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.915955:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.916017:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562545.916070:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783562545.916453:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678336 00000100:00100000:1.0:1783562545.916462:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678336 00000100:00100000:1.0:1783562545.916521:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783562545.916530:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+17:18251:x1870200563678336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562545.916545:0:18248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783562545.916560:0:18248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcc1498400/0x4738ba0933b89e92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89e8b expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.916586:0:18248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcc1498400/0x4738ba0933b89e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89e8b expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.916598:0:18248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcc1498400/0x4738ba0933b89e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89e8b expref: 18 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.916607:0:18248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc1498400, rc 0) 00000100:00100000:1.0:1783562545.916650:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783562545.916658:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783562545.916838:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783562545.916855:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e92 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562545.916864:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89e92 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562545.916921:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.916948:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562545.917072:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218780 going to sleep for 11 seconds 00000100:00100000:3.0:1783562545.917137:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678464 00000100:00100000:3.0:1783562545.917143:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678464 00000100:00100000:2.0:1783562545.917204:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783562545.917215:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783562545.917545:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.917554:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783562545.917667:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.917791:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783562545.917842:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783562545.917874:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6218780 going to sleep for 11 seconds 00000100:00100000:0.0:1783562545.917926:0:18248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678592 00000100:00100000:0.0:1783562545.917932:0:18248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678592 00000100:00100000:0.0:1783562545.917970:0:18248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783562545.917978:0:18248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.918159:0:18248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562545.918166:0:18248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783562545.918244:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf664b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783562545.919118:0:20284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783562545.919503:0:18251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783562545.919521:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562545.919531:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e92 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.919542:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc517d000/0x4738ba0933b89e8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89e92 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783562545.919551:0:18251:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783562545.919554:0:18251:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bfbc1e07800 from 10 10000000:01000000:0.0:1783562545.919556:0:18251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783562545.919589:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.919595:0:18251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.919616:0:18251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.919636:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.919741:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562545.919823:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f480 going to sleep for 11 seconds 00000100:00100000:2.0:1783562545.919857:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678720 00000100:00100000:2.0:1783562545.919865:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678720 00000100:00100000:2.0:1783562545.919950:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783562545.919960:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+18:18251:x1870200563678720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783562545.919971:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562545.919984:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b89ea0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4738ba0933b89e99 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.920007:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b89ea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4738ba0933b89e99 expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.920017:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bfcf6682600/0x4738ba0933b89ea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4738ba0933b89e99 expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562545.920026:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682600, rc 0) 00000100:00100000:2.0:1783562545.920071:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563678720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562545.920077:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783562545.920137:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783562545.920151:0:18251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89ea0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.920160:0:18251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4738ba0933b89ea0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562545.920206:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.920231:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562545.920294:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f480 going to sleep for 11 seconds 00000100:00100000:3.0:1783562545.920350:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678848 00000100:00100000:3.0:1783562545.920355:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678848 00000100:00100000:3.0:1783562545.920377:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783562545.920384:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563678848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783562545.920840:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563678848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 454us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.920848:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783562545.920925:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.920959:0:18251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783562545.921000:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562545.921018:0:18251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf611f480 going to sleep for 11 seconds 00000100:00100000:3.0:1783562545.921069:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563678976 00000100:00100000:3.0:1783562545.921074:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563678976 00000100:00100000:3.0:1783562545.921093:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783562545.921099:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563678976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783562545.921271:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:18251:x1870200563678976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562545.921277:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783562545.921473:0:18251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:985d615a-b40a-4e93-ba73-7a6a65910c9a:18251:1870200563678976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783562545.922854:0:20285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783562545.923039:0:18251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783562545.923070:0:18251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783562545.923083:0:18251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89ea0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562545.923111:0:18251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff9bfcc517dc00/0x4738ba0933b89e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4738ba0933b89ea0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.038666:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783562546.038697:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563679104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783562546.038786:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562546.038858:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563679104 00000100:00100000:0.0:1783562546.038867:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563679104 00000100:00100000:0.0:1783562546.038938:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783562546.038948:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563679104:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783562546.038954:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783562546.038991:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783562546.039103:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563679104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.039112:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783562546.039180:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563679104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783562546.231120:0:20030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783562546.359152:0:18288:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783562546.359170:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562546.359220:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783562546.359230:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1783562546.359540:0:18288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18288:1870200563679232:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783562546.359718:0:18288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf6659600 going to sleep for 11 seconds 00000100:00100000:2.0:1783562546.362363:0:18288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf7122d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18288:1870200563679232:192.168.204.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783562546.367140:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562546.367618:0:18265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240704 00000100:00100000:3.0:1783562546.367630:0:18265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240704 00000100:00100000:3.0:1783562546.367696:0:18265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562546.367708:0:18265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240704:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783562546.367894:0:18265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240704:12345-192.168.204.4@tcp:900:lhsmtool_posix.0 Request processed in 188us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562546.367903:0:18265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:3.0:1783562546.370734:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.370937:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240832 00000100:00100000:2.0:1783562546.370954:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240832 00000100:00100000:2.0:1783562546.371051:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:2.0:1783562546.371064:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240832:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783562546.371183:0:18256:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783562546.371501:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240832:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 438us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.371530:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 38 00000100:00100000:1.0:1783562546.376747:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.376891:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553240960 00000100:00100000:0.0:1783562546.376909:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553240960 00000100:00100000:0.0:1783562546.377008:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:0.0:1783562546.377020:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240960:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783562546.377132:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377155:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377170:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377246:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377290:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377298:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377343:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377354:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377361:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562546.377457:0:20028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783562546.377464:0:20028:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562546.377486:0:20028:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377500:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377507:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377515:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377527:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562546.377532:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377547:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377563:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcdf136400) 00010000:00010000:0.0:1783562546.377566:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562546.377573:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377580:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89ea7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377596:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377602:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377609:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377614:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517d400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562546.377617:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377623:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377629:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562546.377632:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562546.377635:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377649:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89eae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377671:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377677:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377684:0:20028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377689:0:20028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517da00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562546.377692:0:20028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377699:0:20028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377707:0:20028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:0.0:1783562546.377709:0:20028:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783562546.377713:0:20028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.377719:0:20028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89eb5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.377845:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553240960:12345-192.168.204.4@tcp:34:lhsmtool_posix.0 Request processed in 826us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.377853:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 39 00000100:00100000:1.0:1783562546.381452:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.381610:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553241216 00000100:00100000:2.0:1783562546.381623:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553241216 00000100:00100000:2.0:1783562546.381695:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:2.0:1783562546.381706:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+24:17433:x1870200553241216:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.381731:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562546.381755:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2195b expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.381908:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.381927:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.381940:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783562546.381953:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783562546.382107:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382115:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382122:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382129:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.382134:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382159:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382175:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562546.382179:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783562546.382186:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382193:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ec3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382241:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ebc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2195b expref: 26 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382253:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bfcdf136400) 00010000:00010000:2.0:1783562546.382256:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783562546.382260:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2195b expref: 26 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.382269:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682200, rc 0) 00000100:00100000:2.0:1783562546.382344:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+25:17433:x1870200553241216:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 638us (953us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1783562546.382385:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 40 00000100:00100000:3.0:1783562546.386313:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.386447:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553241344 00000100:00100000:0.0:1783562546.386462:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553241344 00000100:00100000:0.0:1783562546.386530:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:0.0:1783562546.386542:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+25:17433:x1870200553241344:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783562546.386590:0:20028:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783562546.386719:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+25:17433:x1870200553241344:12345-192.168.204.4@tcp:53:lhsmtool_posix.0 Request processed in 179us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.386727:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 41 00000100:00100000:1.0:1783562546.391459:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.391610:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553241600 00000100:00100000:2.0:1783562546.391624:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553241600 00000100:00100000:2.0:1783562546.391767:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:2.0:1783562546.391783:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+25:17433:x1870200553241600:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.391852:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562546.391886:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ed1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21962 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783562546.393200:0:18256:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:2.0:1783562546.393212:0:18256:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1783562546.393277:0:18256:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1783562546.393732:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ed8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.393752:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ed8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.393843:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ed8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.393945:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ed1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21962 expref: 28 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.393968:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ed8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21962 expref: 27 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.393979:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcdf136f00) 00010000:00010000:2.0:1783562546.393982:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783562546.393986:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6683200, rc 0) 00000100:00100000:2.0:1783562546.394115:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+27:17433:x1870200553241600:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 2336us (2719us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1783562546.394126:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 42 00000100:00100000:1.0:1783562546.401885:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.402068:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553241856 00000100:00100000:2.0:1783562546.402100:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553241856 00000100:00100000:2.0:1783562546.402173:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:2.0:1783562546.402185:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+27:17433:x1870200553241856:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.402591:0:18254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562546.402621:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89ed8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21962 expref: 27 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402638:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcdf136f00) 00010000:00010000:2.0:1783562546.402648:0:18254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783562546.402670:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402683:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402694:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402713:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402720:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402725:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402899:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402907:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402923:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402930:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.402934:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402942:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402950:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bfcdf136900) 00010000:00010000:2.0:1783562546.402953:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562546.402958:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402964:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682200/0x4738ba0933b89ee6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402973:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402979:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402984:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.402988:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682c00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.402991:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.403006:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.403015:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x5a334b53 (ffff9bfcdf136300) 00010000:00010000:2.0:1783562546.403017:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562546.403024:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.403029:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89eed lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5a334b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.403258:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+26:17433:x1870200553241856:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1073us (1390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783562546.403267:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 43 00000100:00100000:1.0:1783562546.405949:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.406099:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553241984 00000100:00100000:0.0:1783562546.406110:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553241984 00000100:00100000:0.0:1783562546.406209:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:0.0:1783562546.406221:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+26:17433:x1870200553241984:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562546.406252:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562546.406284:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89ef4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21969 expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406339:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89efb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406353:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89efb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406364:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89efb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406522:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89ef4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21969 expref: 28 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406541:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517d400/0x4738ba0933b89efb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21969 expref: 27 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.406556:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562546.406558:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783562546.406562:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517d400, rc 0) 00000100:00100000:0.0:1783562546.406622:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+27:17433:x1870200553241984:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 405us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.406629:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 44 00000100:00100000:1.0:1783562546.410866:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.411187:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553242240 00000100:00100000:0.0:1783562546.411200:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553242240 00000100:00100000:0.0:1783562546.411266:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:0.0:1783562546.411277:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+27:17433:x1870200553242240:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783562546.411388:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.411424:0:20028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.411438:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783562546.411913:0:20028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1783562546.411927:0:20028:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355668522817ns, next at 356668519753ns, rc = 0 00000004:00010000:0.0:1783562546.412305:0:20028:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000842582cd reply state 000000004b4d42cd transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.412318:0:20028:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562546.412644:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+29:17433:x1870200553242240:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 1364us (1791us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1783562546.412671:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 45 00000100:00100000:1.0:1783562546.416353:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.416455:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553242368 00000100:00100000:2.0:1783562546.416470:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553242368 00000100:00100000:2.0:1783562546.416603:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:2.0:1783562546.416627:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+29:17433:x1870200553242368:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.416668:0:18256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562546.416702:0:18256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21970 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.416810:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 30 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.416831:0:18256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 30 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.416886:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:2.0:1783562546.416890:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562546.416895:0:18256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682c00, rc 0) 00000100:00100000:2.0:1783562546.416995:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+30:17433:x1870200553242368:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 381us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.417002:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00010000:00010000:0.0:1783562546.417567:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417580:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417588:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417595:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:0.0:1783562546.417602:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417613:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417632:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562546.417635:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783562546.417639:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.417645:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f02 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.425599:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.426090:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553242496 00000100:00100000:0.0:1783562546.426109:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553242496 00000100:00100000:0.0:1783562546.426214:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:0.0:1783562546.426567:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2363:x1870200553242496:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783562546.428238:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2363:x1870200553242496:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 1671us (2649us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783562546.428670:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:3.0:1783562546.432400:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.432890:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553242752 00000100:00100000:0.0:1783562546.432908:0:18258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553242752 00000100:00100000:0.0:1783562546.433011:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:0.0:1783562546.433023:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+29:17433:x1870200553242752:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783562546.433328:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+30:17433:x1870200553242752:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 306us (951us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1783562546.433336:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1783562546.437066:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.437215:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243008 00000100:00100000:2.0:1783562546.437228:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243008 00000100:00100000:2.0:1783562546.437351:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:2.0:1783562546.437364:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+30:17433:x1870200553243008:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783562546.437553:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+30:17433:x1870200553243008:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 192us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.437562:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:1.0:1783562546.441585:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.441879:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243136 00000100:00100000:0.0:1783562546.441896:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243136 00000100:00100000:0.0:1783562546.442020:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:0.0:1783562546.442037:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+30:17433:x1870200553243136:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783562546.442245:0:18255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783562546.442277:0:18255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f10 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c21977 expref: -99 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442377:0:18255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442394:0:18255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442499:0:18255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783562546.442558:0:18255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783562546.442589:0:18255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442666:0:18255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f10 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21977 expref: 32 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442691:0:18255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21977 expref: 31 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.442700:0:18255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562546.442703:0:18255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783562546.442709:0:18255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcc517da00, rc 0) 00000100:00100000:0.0:1783562546.442821:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+31:17433:x1870200553243136:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 787us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.442829:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:3.0:1783562546.447073:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.447193:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243264 00000100:00100000:2.0:1783562546.447205:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243264 00000100:00100000:2.0:1783562546.447297:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:2.0:1783562546.447317:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+6:2362:x1870200553243264:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.447345:0:18891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783562546.447435:0:18891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4e648e50c8c2197e expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783562546.447485:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4f0131, blocks: 0x1 00010000:00010000:2.0:1783562546.447518:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1783562546.447524:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.447558:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 7 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.447589:0:18891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 7 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.447609:0:18891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bfcf6682200, rc 0) 00000100:00100000:2.0:1783562546.447702:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:2362:x1870200553243264:12345-192.168.204.4@tcp:101:lhsmtool_posix.0 Request processed in 394us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.447711:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:1.0:1783562546.450687:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.450831:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243520 00000100:00100000:0.0:1783562546.450846:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243520 00000100:00100000:0.0:1783562546.450923:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:0.0:1783562546.450940:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+31:17433:x1870200553243520:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783562546.451243:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+31:17433:x1870200553243520:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 306us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.451253:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:0.0:1783562546.454606:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.454721:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243648 00000100:00100000:2.0:1783562546.454740:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243648 00000100:00100000:2.0:1783562546.454839:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:2.0:1783562546.454854:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+31:17433:x1870200553243648:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783562546.489466:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1783562546.489489:0:5776:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1783562546.489510:0:5776:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1783562546.489642:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17433:x1870200553243648:12345-192.168.204.4@tcp:44:lhsmtool_posix.0 Request processed in 34783us (35296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783562546.489656:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:1.0:1783562546.489711:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563679360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783562546.489802:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783562546.489857:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563679360 00000100:00100000:0.0:1783562546.489867:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563679360 00000100:00100000:0.0:1783562546.489938:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783562546.489950:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1870200563679360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783562546.490463:0:18889:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783562546.490468:0:18889:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783562546.490470:0:18889:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783562546.490472:0:18889:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1783562545 -> 1783562545 00002000:00010000:0.0:1783562546.490474:0:18889:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783562546.490513:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1870200563679360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 566us (723us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1783562546.490519:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1783562546.490570:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bfcef1ea680/2, rc 0, transno 12884901891 00000100:00100000:1.0:1783562546.490580:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3275:1870200563679360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783562546.493157:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562546.493247:0:19334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553243776 00000100:00100000:3.0:1783562546.493266:0:19334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553243776 00000100:00100000:3.0:1783562546.493450:0:19334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:3.0:1783562546.493466:0:19334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:2363:x1870200553243776:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783562546.493656:0:19334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:2363:x1870200553243776:12345-192.168.204.4@tcp:16:lhsmtool_posix.0 Request processed in 194us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562546.493665:0:19334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:2.0:1783562546.499598:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.499847:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244032 00000100:00100000:0.0:1783562546.499867:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244032 00000100:00100000:0.0:1783562546.500004:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:0.0:1783562546.500019:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17433:x1870200553244032:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783562546.500126:0:18254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783562546.500166:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517da00/0x4738ba0933b89f17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21977 expref: 14 pid: 18255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.500261:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:0.0:1783562546.500269:0:18254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783562546.500326:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.500347:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.500360:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783562546.500765:0:18254:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d828799b reply state 00000000f44a2793 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.500779:0:18254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783562546.500951:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:17433:x1870200553244032:12345-192.168.204.4@tcp:36:lhsmtool_posix.0 Request processed in 934us (1369us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1783562546.500961:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00010000:00010000:2.0:1783562546.505657:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.505668:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1783562546.505679:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.505814:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244160 00000100:00100000:0.0:1783562546.505832:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244160 00010000:00010000:2.0:1783562546.505836:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.505845:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517c000 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.505853:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.505864:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.505923:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:2.0:1783562546.505927:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562546.505934:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.505936:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00010000:00010000:2.0:1783562546.505942:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcc517c000/0x4738ba0933b89f25 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.505949:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:2363:x1870200553244160:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783562546.506282:0:18890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783562546.506287:0:18890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1783562544 00002000:00010000:0.0:1783562546.506290:0:18890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1783562544 00002000:00010000:0.0:1783562546.506293:0:18890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1783562545 -> 1783562544 00002000:00010000:0.0:1783562546.506295:0:18890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783562546.506395:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+8:2363:x1870200553244160:12345-192.168.204.4@tcp:2:lhsmtool_posix.0 Request processed in 446us (739us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1783562546.506665:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:1.0:1783562546.509602:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.509698:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244288 00000100:00100000:2.0:1783562546.509715:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244288 00000100:00100000:2.0:1783562546.509807:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562546.509823:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+8:2362:x1870200553244288:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.509901:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.509930:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.509936:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.509945:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.509963:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510013:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510024:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510056:0:18891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510065:0:18891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562546.510071:0:18891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510083:0:18891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510102:0:18891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.510111:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.510345:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+8:2362:x1870200553244288:12345-192.168.204.4@tcp:1:lhsmtool_posix.0 Request processed in 525us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.510354:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1783562546.513612:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.513706:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244544 00000100:00100000:0.0:1783562546.513721:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244544 00000100:00100000:2.0:1783562546.513837:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:2.0:1783562546.513861:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:17433:x1870200553244544:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783562546.514000:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514049:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514061:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514512:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514530:0:18256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 15 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514541:0:18256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514599:0:18256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 15 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.514617:0:18256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 15 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.514642:0:18256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18256:1870200563679488:192.168.204.4@tcp:104: 00000100:00100000:2.0:1783562546.514775:0:18256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc29eb780 going to sleep for 11 seconds 00000100:00100000:1.0:1783562546.522994:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.523197:0:18256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18256:1870200563679488:192.168.204.4@tcp:104: 00010000:00010000:2.0:1783562546.523241:0:18256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562546.523983:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244672 00000100:00100000:3.0:1783562546.523996:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244672 00010000:00010000:3.0:1783562546.524058:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 16 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562546.524186:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1783562546.524198:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:2364:x1870200553244672:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783562546.524243:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783562546.524252:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 16 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524267:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 16 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524297:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682c00/0x4738ba0933b89f09 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21970 expref: 16 pid: 18256 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524320:0:18240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:3.0:1783562546.524325:0:18240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524339:0:18240:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524347:0:18240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.524614:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783562546.524698:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:2364:x1870200553244672:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 495us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562546.524708:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00010000:00010000:2.0:1783562546.524768:0:18256:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.524783:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562546.525094:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1783562546.525271:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1783562546.525316:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1783562546.525645:0:18256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18256:1870200563679616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783562546.525891:0:18256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562546.525984:0:18256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc29eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1783562546.526150:0:18259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563679616 00000100:00100000:3.0:1783562546.526160:0:18259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563679616 00000100:00100000:3.0:1783562546.526223:0:18259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783562546.526234:0:18259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18256:x1870200563679616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783562546.526368:0:18259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18256:x1870200563679616:12345-0@lo:1000:mdt00_002.0 Request processed in 120us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562546.526392:0:18259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783562546.526565:0:18256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18256:1870200563679616:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783562546.527678:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1783562546.527822:0:18256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18256:1870200563679744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783562546.527915:0:18256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562546.527962:0:18256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc29eb780 going to sleep for 11 seconds 00000100:00100000:3.0:1783562546.528017:0:18259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563679744 00000100:00100000:3.0:1783562546.528031:0:18259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563679744 00000100:00100000:3.0:1783562546.528098:0:18259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783562546.528109:0:18259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18256:x1870200563679744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783562546.529193:0:18259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18256:x1870200563679744:12345-0@lo:1000:mdt00_002.0 Request processed in 1078us (1269us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783562546.529210:0:18259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783562546.529269:0:18256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18256:1870200563679744:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783562546.529328:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529339:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529345:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529349:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683200 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.529355:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529382:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529636:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:2.0:1783562546.529641:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562546.529648:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529656:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683200/0x4738ba0933b89f3a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529707:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529713:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529718:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529723:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683400 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.529726:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529733:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529741:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562546.529744:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783562546.529756:0:18256:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 18 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529781:0:18256:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 18 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529804:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 18 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.529916:0:18256:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683c00/0x4738ba0933b89e76 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c21954 expref: 18 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.529936:0:18256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18256:1870200563679872:192.168.204.4@tcp:105: 00000100:00100000:2.0:1783562546.531233:0:18256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcc29eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1783562546.534029:0:18256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18256:1870200563679872:192.168.204.4@tcp:105: 00010000:00010000:2.0:1783562546.534071:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534083:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683400/0x4738ba0933b89e6f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534122:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534139:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534155:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534170:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534205:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534212:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534219:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.534225:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534233:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534251:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562546.534254:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783562546.534258:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534264:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6683e00/0x4738ba0933b89f41 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534275:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534281:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534287:0:18256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534293:0:18256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1e884f0) 00010000:00010000:2.0:1783562546.534302:0:18256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534309:0:18256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534317:0:18256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bfcc3bd0000) 00010000:00010000:2.0:1783562546.534320:0:18256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783562546.534323:0:18256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.534329:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f33 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.534711:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:17433:x1870200553244544:12345-192.168.204.4@tcp:57:lhsmtool_posix.0 Request processed in 20851us (21117us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1783562546.534723:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000020:00080000:2.0:1783562546.534730:0:18256:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783562546.534935:0:18288:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783562546.534947:0:18288:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783562546.534987:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783562546.534996:0:18288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1783562546.535385:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.535902:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553244800 00000100:00100000:2.0:1783562546.535920:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553244800 00000100:00100000:2.0:1783562546.536050:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:2.0:1783562546.536067:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcc5c61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:17432:x1870200553244800:12345-192.168.204.4@tcp:49:dd.0 00000100:00100000:2.0:1783562546.536224:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcc5c61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:17432:x1870200553244800:12345-192.168.204.4@tcp:49:dd.0 Request processed in 161us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.536233:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1783562546.538519:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.538740:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245056 00000100:00100000:2.0:1783562546.538759:0:18258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245056 00000100:00100000:2.0:1783562546.540196:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:2.0:1783562546.540233:0:18258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+18:17433:x1870200553245056:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783562546.542186:0:18258:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783562546.542336:0:18258:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1783562546.542725:0:18258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542754:0:18258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542770:0:18258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542783:0:18258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542799:0:18258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542807:0:18258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.542838:0:18258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783562546.542891:0:18243:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783562546.542905:0:18243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.542915:0:18243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562546.542923:0:18243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.542935:0:18243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.542955:0:18243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bfcd0d05e00) 00010000:00010000:1.0:1783562546.542959:0:18243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783562546.542966:0:18243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.542974:0:18243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bfcf6682e00/0x4738ba0933b89f48 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18258 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.542993:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562546.542995:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783562546.542997:0:18243:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562546.543081:0:18258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+20:17433:x1870200553245056:12345-192.168.204.4@tcp:35:lhsmtool_posix.0 Request processed in 2860us (4575us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1783562546.543095:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00000020:00080000:2.0:1783562546.543262:0:18258:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783562546.637853:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.639806:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245184 00000100:00100000:2.0:1783562546.639832:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245184 00000100:00100000:0.0:1783562546.639867:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562546.640116:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245312 00000100:00100000:1.0:1783562546.640141:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245312 00000100:00100000:1.0:1783562546.640218:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562546.640233:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:2361:x1870200553245312:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:1.0:1783562546.640283:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.640309:0:18895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 9 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.640317:0:18895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562546.640321:0:18895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562546.640326:0:18895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.640395:0:18895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 9 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.640442:0:18895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 9 pid: 18891 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.640453:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562546.640477:0:18895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcf6522300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:18895:1870200563680000:192.168.204.4@tcp:104: 00000100:00100000:3.0:1783562546.640578:0:18894:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783562546.640590:0:18894:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1783562546.640646:0:18895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bfcf62183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783562546.640844:0:18896:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783562546.640861:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245440 00000100:00100000:2.0:1783562546.640865:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245440 00000100:00100000:0.0:1783562546.641841:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1783562546.641927:0:18896:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783562546.641949:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245568 00000100:00100000:2.0:1783562546.641956:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245568 00000100:00100000:1.0:1783562546.642975:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562546.643022:0:18896:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1783562546.643038:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245696 00000100:00100000:1.0:1783562546.643049:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245696 00000100:00100000:3.0:1783562546.643304:0:20287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:3.0:1783562546.643335:0:20287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+12:2362:x1870200553245184:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:3.0:1783562546.643434:0:20287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.643466:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562546.643473:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562546.643479:0:20287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.643492:0:20287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.643922:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1783562546.644021:0:18896:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783562546.644045:0:18896:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1783562546.644345:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245824 00000100:00100000:1.0:1783562546.644358:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245824 00000100:00100000:3.0:1783562546.644912:0:20288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:3.0:1783562546.644929:0:20288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+12:2362:x1870200553245440:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:3.0:1783562546.644982:0:20288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.645001:0:20288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562546.645007:0:20288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562546.645011:0:20288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.645021:0:20288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.647890:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.647956:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1783562546.648023:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1783562546.648047:0:18896:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1783562546.648071:0:18896:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1783562546.648072:0:18894:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1783562546.648090:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553245952 00000100:00100000:0.0:1783562546.648100:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553245952 00000100:00100000:0.0:1783562546.648156:0:18894:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1783562546.648161:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553246208 00000100:00100000:0.0:1783562546.648164:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553246208 00000100:00100000:2.0:1783562546.648451:0:20271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200553246080 00000100:00100000:2.0:1783562546.648457:0:20271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200553246080 00010000:00010000:2.0:1783562546.648491:0:20271:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 16 pid: 18891 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.648528:0:20271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562546.648537:0:20271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:2363:x1870200553246080:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783562546.648554:0:20271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783562546.648575:0:20271:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 16 pid: 18891 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648587:0:20271:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 16 pid: 18891 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648610:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648614:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648621:0:20271:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648632:0:20271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648643:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648646:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648650:0:20271:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648665:0:20271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648673:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648675:0:20271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.648678:0:20271:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648682:0:20271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648711:0:20271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783562546.648745:0:20288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648746:0:20287:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.648803:0:20288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.648804:0:20287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.648888:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854e37c7/0x4738ba0933b89f1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x4e648e50c8c2197e expref: 16 pid: 18891 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.648904:0:18895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcf6522300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:18895:1870200563680000:192.168.204.4@tcp:104: 00010000:00010000:1.0:1783562546.648945:0:18895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.648956:0:18895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.648962:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.650388:0:20271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:2363:x1870200553246080:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1844us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562546.650425:0:20271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1783562546.652339:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:2.0:1783562546.652375:0:20289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:2362:x1870200553245568:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:2.0:1783562546.652494:0:20289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.652536:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.652542:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.652552:0:20289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.652576:0:20289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562546.747154:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901892 is committed 00000001:00080000:2.0:1783562546.747193:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:2.0:1783562546.747207:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:2.0:1783562546.747222:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:3.0:1783562546.747380:0:20287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1783562546.747387:0:20287:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1783562544 -> 1783562545 00002000:00010000:3.0:1783562546.747390:0:20287:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1783562544 -> 1783562545 00002000:00010000:3.0:1783562546.747393:0:20287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1783562546.747461:0:20287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747479:0:20287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747492:0:20287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747500:0:20287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031a00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562546.747508:0:20287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747519:0:20287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747558:0:20287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747567:0:20287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bfe5aa2/0x4738ba0933b89f56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562546.747792:0:20287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+21:2362:x1870200553245184:12345-192.168.204.4@tcp:4:dd.0 Request processed in 104452us (109949us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1783562546.747808:0:20287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1 00000100:00100000:3.0:1783562546.747868:0:20287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 4 00000100:00100000:3.0:1783562546.747891:0:20287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+20:2361:x1870200553245696:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:3.0:1783562546.747974:0:20287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.747993:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783562546.747999:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783562546.748009:0:20287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.748033:0:20287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783562546.799034:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:2.0:1783562546.799198:0:20289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1783562546.799204:0:20289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1783562546.799225:0:20289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799242:0:20289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799252:0:20289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799260:0:20289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6683e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562546.799268:0:20289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799300:0:20289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799332:0:20289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799341:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4449c4/0x4738ba0933b89f64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.799569:0:20289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+16:2362:x1870200553245568:12345-192.168.204.4@tcp:4:dd.0 Request processed in 147203us (157725us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1783562546.799582:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 3 00000100:00100000:2.0:1783562546.799632:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 5 00000100:00100000:2.0:1783562546.799648:0:20289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:2361:x1870200553245824:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:2.0:1783562546.799690:0:20289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799706:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.799710:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783562546.799718:0:20289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.799732:0:20289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800457:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800472:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800480:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800489:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1498e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562546.800493:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800510:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800528:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800537:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63029e8/0x4738ba0933b89f4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.800613:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+15:2361:x1870200553245312:12345-192.168.204.4@tcp:4:dd.0 Request processed in 160379us (160760us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783562546.800623:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 0 00000100:00100000:1.0:1783562546.800649:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 6 00000100:00100000:1.0:1783562546.800659:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+14:2362:x1870200553245952:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:1.0:1783562546.800681:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800692:0:18895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562546.800695:0:18895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783562546.800701:0:18895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.800712:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783562546.803666:0:20288:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1783562546.803693:0:20288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803706:0:20288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803714:0:20288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803719:0:20288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0030c00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:0.0:1783562546.803725:0:20288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803733:0:20288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803821:0:20288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.803831:0:20288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000188018bb/0x4738ba0933b89f5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783562546.804016:0:20288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+13:2362:x1870200553245440:12345-192.168.204.4@tcp:4:dd.0 Request processed in 159085us (163560us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783562546.804031:0:20288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 2 00000100:00100000:0.0:1783562546.804085:0:20288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:0.0:1783562546.804103:0:20288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+12:2362:x1870200553246208:12345-192.168.204.4@tcp:4:dd.0 00010000:00010000:0.0:1783562546.804141:0:20288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.804156:0:20288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562546.804162:0:20288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783562546.804170:0:20288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783562546.804184:0:20288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783562546.856879:0:20287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 5242880 -> 7654321 00010000:00010000:1.0:1783562546.856908:0:20287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856925:0:20287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856935:0:20287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856944:0:20287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc0031800 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:1.0:1783562546.856950:0:20287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856960:0:20287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856983:0:20287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783562546.856991:0:20287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d75cfa5/0x4738ba0933b89f6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783562546.857108:0:20287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcf6520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+19:2361:x1870200553245696:12345-192.168.204.4@tcp:4:dd.0 Request processed in 109220us (214133us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1783562546.857141:0:20287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 4 00000001:00080000:0.0:1783562546.857360:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00000001:00080000:1.0:1783562546.897042:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00000001:00080000:1.0:1783562546.897076:0:6574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:3.0:1783562546.897137:0:20289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:3.0:1783562546.897157:0:20289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897172:0:20289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897181:0:20289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897189:0:20289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcf6682e00 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:3.0:1783562546.897193:0:20289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897205:0:20289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897265:0:20289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783562546.897273:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b98a915a/0x4738ba0933b89f72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783562546.897438:0:20289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+9:2361:x1870200553245824:12345-192.168.204.4@tcp:4:dd.0 Request processed in 97788us (253508us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1783562546.897764:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 5 00010000:00010000:2.0:1783562546.898059:0:20288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898074:0:20288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898083:0:20288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898090:0:20288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc517d200 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562546.898094:0:20288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898102:0:20288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898117:0:20288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898137:0:20288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ac5fb1/0x4738ba0933b89f80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.898194:0:20288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+7:2362:x1870200553246208:12345-192.168.204.4@tcp:4:dd.0 Request processed in 94097us (250171us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1783562546.898202:0:20288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00010000:00010000:2.0:1783562546.898257:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898267:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898274:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898838:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bfcc1499000 already unused, calling callback (ffffffffc1481e90) 00010000:00010000:2.0:1783562546.898847:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898858:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898870:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783562546.898879:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089fa2a8f/0x4738ba0933b89f79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783562546.898939:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfceed9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f29ebd6c-dd7b-4a57-ad8c-1dddf6b9d848+5:2362:x1870200553245952:12345-192.168.204.4@tcp:4:dd.0 Request processed in 98280us (250979us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783562546.898948:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 6 00010000:00010000:1.0:1783562547.254912:0:19339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783562547.827185:0:20327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783562548.278603:0:18242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783562548.598622:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783562548.598720:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562548.598828:0:18893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680128 00000100:00100000:2.0:1783562548.598839:0:18893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680128 00000100:00100000:2.0:1783562548.598921:0:18893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783562548.598933:0:18893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563680128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783562548.598983:0:18893:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783562548.599030:0:18893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1870200563680128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562548.599038:0:18893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783562548.599078:0:3275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563680512:0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.599114:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783562548.599119:0:3274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563680384:0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.599156:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680512 00000100:00100000:2.0:1783562548.599161:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562548.599162:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680512 00000100:00100000:3.0:1783562548.599204:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783562548.599211:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783562548.599215:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563680512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.599233:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680384 00000100:00100000:2.0:1783562548.599239:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680384 00000100:00100000:2.0:1783562548.599281:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562548.599289:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563680384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.599325:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1870200563680384:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562548.599332:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783562548.599356:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:985d615a-b40a-4e93-ba73-7a6a65910c9a:3273:1870200563680256:0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.599388:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562548.599533:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1870200563680512:12345-0@lo:400:kworker.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562548.599541:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783562548.599982:0:3273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563680768:0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.600011:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783562548.600121:0:3275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3275:1870200563680512:0@lo:400:kworker.0 00000100:00080000:3.0:1783562548.600162:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783562548.600182:0:3272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bfcef1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563680640:0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.600233:0:3274:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:3.0:1783562548.600239:0:3274:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bfcef1ea680, transno 12884901891 00000100:00100000:2.0:1783562548.600277:0:18249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680256 00000100:00100000:2.0:1783562548.600282:0:18249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680256 00000100:00100000:2.0:1783562548.600318:0:18249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783562548.600323:0:18249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3273:x1870200563680256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.600360:0:18249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:985d615a-b40a-4e93-ba73-7a6a65910c9a+19:3273:x1870200563680256:12345-0@lo:400:kworker.0 Request processed in 36us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783562548.600367:0:18249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783562548.600426:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:985d615a-b40a-4e93-ba73-7a6a65910c9a:3273:1870200563680256:0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.600444:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783562548.600460:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1783562548.600470:0:3272:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1783562548.600493:0:3274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3274:1870200563680384:0@lo:400:kworker.0 00000100:00100000:2.0:1783562548.600493:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfceed9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3272:1870200563680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783562548.600533:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680768 00000100:00100000:3.0:1783562548.600537:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680768 00000100:00100000:3.0:1783562548.600675:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870200563680640 00000100:00100000:3.0:1783562548.600680:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870200563680640 00000100:00080000:2.0:1783562548.600704:0:18250:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783562548.600855:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562548.600862:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563680768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.600903:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1870200563680768:12345-0@lo:400:kworker.0 Request processed in 42us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562548.600911:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783562548.600925:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562548.600932:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563680640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.600965:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bfcef1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1870200563680640:12345-0@lo:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783562548.600971:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783562548.601007:0:3273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3273:1870200563680768:0@lo:400:kworker.0 00000100:00100000:3.0:1783562548.601043:0:3272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bfcef1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3272:1870200563680640:0@lo:400:kworker.0 Debug log: 38718 lines, 38718 kept, 0 dropped, 0 bad.